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FOREWORD 

The  most  striking  breakthrough  in  business  and  economic  re- 
search in  the  past  two  decades  has  been  the  development  of  new 
empirical  techniques  which  are  frequently  classified  under  the  some- 
what nebulous  title  of  "operations  research."  Perhaps  the  most  fruit- 
ful of  these  new  techniques  is  linear  programming,  an  outgrowth  of 
game  theory  concepts  which  were  first  conceived  by  the  late  John  von 
Neumann  in  the  1920's. 

While  the  pragmatic  value  of  mathematical  programming  is  in- 
contestable, the  extent  of  its  contribution  to  the  content  of  economic 
theory  may  remain  unsettled  for  many  years.  Still,  it  seems  clear  that 
an  understanding  of  the  rationale  of  linear  programming  and  game 
theory  is  mandatory  for  both  the  practicing  business  economist  and 
the  economic  theorist.  A  majority  of  the  practicing  business  econo- 
mists and  many  academic  economists  may  be  inadequately  prepared 
mathematically,  however,  to  learn  what  they  need  to  know  about 
these  subjects. 

In  view  of  this  state  of  affairs  it  is  easy  to  understand  why  I  wel- 
come a  book  which  breaks  this  impasse  by  presenting  an  accurate  and 
largely  self-contained  exposition,  bringing  these  subjects  within  the 
grasp  of  intelligent  people  with  little  training  in  higher  mathema- 
tics. 

While  a  knowledge  of  college  algebra  is  essential  and  an  acquaint- 
ance with  analytical  geometry  desirable,  the  most  important  require- 
ments for  studying  Mr.  Bennion's  amazingly  clear  and  patiently 
developed  exposition  are  sufficient  motivation  and  staying  power. 
These  qualities  are  standard  equipment  with  many  business  econo- 
mists and  most  academicians. 

Edward  G.  Bennion  is  Consulting  Economist  for  the  General  Eco- 
nomics Department  of  the  Standard  Oil  Company  (New  Jersey) .  He 
received  his  Ph.D.  from  Harvard,  and  has  taught  there  as  well  as  at 
the  Massachusetts  Institute  of  Technology,  Yale  and  the  Columbia 
Graduate  School  of  Business.  The  general  economic  work  at  Jersey 
was  conceived  and  developed  under  his  leadership  and  headed  by  him 
from  its  inception  in  1945  until  1953,  when  he  abandoned  administra- 
tion for  his  present  activities.  One  of  his  major  interests  in  the  re- 
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search  field  has  been  the  development  and  application  of  methods  to 
improve  the  value  of  general  economic  work  in  business  decision- 
making. The  present  book  is  the  outgrowth  of  that  interest. 


Richard  C.  Henshaw,  Jr. 
Professor  of  Business  Administration 
Michigan  State  University 


PREFACE 

Alexander  Gray  once  expressed  the  view  that  the  outrageous  im- 
balance between  the  supply  of  books  and  the  demand  for  them  made 
it  incumbent  on  the  would-be  author  to  advise  his  potential  audience 
as  to  just  what  burning  need  he  imagined  his  own  literary  gem  might 
fill.1  Some  attempt  in  this  direction  is  made,  for  this  volume,  in  the 
early  pages  of  the  first  chapter.  This  makes  it  possible  to  devote  the 
preface  to  warning  the  reader  of  the  author's  limited  qualifications, 
and  to  making  the  customary  acknowledgments,  which  are  largely  in 
the  form  of  apologies  for  such  flagrant  plagiarism. 

This  book  was  written  for  what  might  be  called  the  curious-mathe- 
matical-lowbrow class,  though  the  thoughtful  reader  may  elevate 
himself  to  the  low-middle  brow  group  before  he  is  through.  The 
author  is  a  charter  member  of  the  curious-lowbrow  fraternity,  and 
has  made  a  conscientious  attempt  to  educate  himself  on  what  seem 
to  him  the  more  important  mathematical  fundamentals.  These  are 
his  principal  qualifications  for  writing  a  book  on  this  subject,  since 
one  who  has  gone  through  the  ordeal  of  self-education  in  any  mathe- 
matical area  is  almost  sure  to  have  a  greater  awareness  of  the  prob- 
lems of  this  learning  process  than  would  a  man  with  more  formal 
training. 

Having  learned  the  hard  way,  the  writer  has  tried  to  initiate  the 
coverage  of  this  book  at  a  reasonably  low  mathematical  level.  At 
least  to  the  writer's  knowledge,  there  is  no  other  book  available  which 
has  the  objective  of  imparting  an  understanding  of  the  rationale  un- 
derlying linear  programming  and  game  theory  and  which  also  as- 
sumes so  little  advanced  mathematical  knowledge  at  the  outset.  And, 
as  a  further  aid  to  his  fellow  lowbrows,  the  writer  has  generally 
chosen  the  somewhat  unscientific  course  of  backing  into  mathemati- 
cal generalizations  from  specific  examples. 

Following  this  course  makes  easier,  for  the  mathematically  unso- 
phisticated, an  understanding  of  mathematical  generalizations.  None 
of  this  means,  however,  that  one  can  expect  simple  answers  to  com- 
plicated problems,  and  it  would  be  misleading  to  pretend  that  this  is 

1  Alexander  Gray,  The  Development  of  Economic  Doctrine  (New  York:  Longmans,  Green 
and  Company,  1933),  p.  5. 
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a  simple  book  from  other  than  a  mathematician's  viewpoint.  The 
ultimate  generalizations  are  vital  to  an  understanding  of  rationale; 
and  these  generalizations  sometimes  necessarily  rest  on  rather  ab- 
stract chains  of  reasoning  involving  compact  mathematical  notation. 
Neither  the  reasoning  nor  the  notation  are  immediately  second-nature 
to  the  non-mathematician,  even  when  he  is  eased  into  these  as  gently 
as  the  writer  has  tried  to  do. 

This  compromising  approach  unquestionably  leaves  more  to  intu- 
ition than  is  desirable  from  a  mathematician's  viewpoint,  and  the 
writer  would  be  among  the  first  to  defend  the  mathematician's  view- 
point. The  most  desirable  method  of  learning  would  clearly  be  for 
each  of  us  to  sit  at  the  feet  of  bona  fide  mathematicians;  and  such  is 
rightly  one  of  the  current  objectives  in  secondary  schools  and  institu- 
tions of  higher  education.  But  this  is  too  expensive  and  slow  for  those 
of  us  who  lacked  the  foresight  to  grasp  this  opportunity  in  our  youth. 
This  no-longer-so-youthful  group  has,  if  the  area  covered  by  this 
book  is  an  important  one,  only  two  alternatives:  to  roll  up  its  sleeves 
and  sweat  a  bit  in  the  interests  of  self-education,  or  to  risk  withering 
slowly  on  the  vine.  This  book  was  written  to  help  those  who  wish  to 
choose  the  former  course. 

While  most  of  those  to  whom  the  author  is  indebted  for  this 
volume  are  known  only  to  himself,  it  is  desirable  to  make  some  ex- 
plicit acknowledgments — in  the  interest  of  a  clear  conscience,  if  for 
no  other  reason.  Directly  or  indirectly,  and  almost  by  definition,  most 
books  savoring  of  a  text  might  be  regarded  as  a  sort  of  ethically 
acceptable  form  of  plagiarism.  This  book  is  a  blatant  example  of  this 
type  of  theft,  since  its  contribution  (if  it  may  be  dignified  with  that 
description)  is  to  bring  its  subject  matter  more  easily  within  the  reach 
of  the  mathematically  unsophisticated.  The  least  the  writer  can  do, 
therefore,  is  to  indicate  those  he  has  drawn  upon  most. 

The  coverage,  approach,  and  organization  of  this  book — along  with 
such  vital  underlying  understanding  as  the  author  hopes  he  ulti- 
mately came  to  possess — have  been  largely  drawn  from  three  sources: 
(1)  Charnes,  Cooper,  and  Henderson,  An  Introduction  to  Linear  Pro- 
gramming, Part  II  (John  Wiley  and  Sons,  Inc.,  1953);  (2)  Dorfman, 
Samuelson,  and  Solow,  Linear  Programming  and  Economic  Analysis 
(McGraw-Hill  Book  Company,  Inc.,  1958);  and  (3)  Vajda,  The  The- 
ory of  Games  and  Linear  Programming  (Methuen  and  Co.,  Ltd.,  1956). 
There  are  numerous  other  fine  books  in  this  field  on  the  market,  of 
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course,  but  none  with  which  the  writer  is  familiar  comes  quite  as  close 
to  meeting  this  writer's  requirements — and  even  these  three  require 
rather  substantial  effort  and  more  mathematical  sophistication  than 
one  normally  imputes  to  mathematical  lowbrows. 

The  writer  has  been  guilty  of  no  more  than  petty  larceny  with  re- 
spect to  the  first  of  these  sources,  but  he  has  been  guilty  of  something 
closer  to  grand  larceny  with  respect  to  the  second  source  for  the  con- 
cluding chapter  of  this  book.  This  stoop  to  levels  no  lower  than  petty 
larceny  and  limited  grand  larceny  should  not  be  regarded  as  any  less 
of  a  compliment.  Even  if  the  market  abounded  (which  it  does  not) 
with  books  relating  the  techniques  of  game  theory  and  linear  pro- 
gramming to  economic  analysis,  for  example,  it  is  hard  to  imagine  a 
better,  or  to  economists  a  more  imperative,  book  than  Dorfman, 
Samuelson,  and  Solow,  which  is  written  with  the  clarity  one  always 
expects  from  these  authors.  But  one  must  first  learn  to  walk  among 
the  techniques  themselves,  before  attempting  to  run  in  a  particular 
field  in  which  they  can  be  applied.  This  volume  has,  for  the  most  part, 
been  intentionally  confined  to  the  simpler  objective  of  merely  learning 
to  walk. 

Even  if  it  is  not  entirely  obvious  to  the  reader,  considerable  grand 
larceny  has  been  employed  in  the  writer's  drawing  upon  Vajda's  fine 
little  book,  primarily  because  Vajda's  coverage  and  (in  somewhat 
lesser  degree)  his  organization  agree  so  closely  with  the  writer's  notion 
of  what  should  be  the  first  step  in  an  induction  into  the  techniques  of 
linear  programming  and  game  theory.  Vajda's  book  is  more  than  a 
book  simply  having  a  coverage  and  organization  with  which  the 
writer  is  in  sympathy;  it  is  also  a  quite  well- written  book.  Its  real 
drawback  is  that  it  is  not  self-contained,  except  for  one  with  a  fair 
degree  of  mathematical  maturity. 

Unless  one  understands  the  rudiments  of  matrix  algebra  notation, 
has  a  passably  broad  knowledge  of  matrix  algebra  concepts,  and  is 
sufficiently  facile  in  mathematics  to  be  able  readily  to  fill  in  steps  in 
proofs  that  are  omitted  (presumably  because  these  steps  are  too  ob- 
vious to  the  sophisticated  to  warrant  wasting  space  on  them) — unless 
one  can  meet  these  three  requirements,  one  is  sure  to  have  a  difficult 
time  achieving  a  real  understanding  of  the  fundamentals  of  linear 
programming  and  game  theory  from  Vajda's  little  book.  On  the  other 
hand,  for  one  who  can  satisfy  these  requirements,  Vajda's  book  is,  in 
the  writer's  opinion,  to  those  earnestly  seeking  to  learn  to  walk  with 
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some  assurance  among  the  techniques  involved,  what  Dorfman, 
Samuelson,  and  Solow  is  to  the  properly  grounded  economist. 

While  the  writer  profited  substantially  from  numerous  additional 
works  in  this  field  and  would  recommend  these  works  with  equal  en- 
thusiasm for  the  person  who  has  passed  the  initial  growing-pains 
stage,  his  real  debt  with  respect  to  this  volume  is  to  the  three  above- 
mentioned  books.  To  learn  a  little  about  the  what,  and  even  about 
the  how  of  linear  programming  and  game  theory,  is  a  simple  (though 
decidedly  unsatisfying)  chore.  To  couple  these  with  the  much  more 
fundamental  why  of  linear  programming  and  game  theory  techniques 
is,  however,  a  truly  rugged  and  time-consuming  ordeal  for  the  mathe- 
matically unsophisticated.  The  task  would  have  been  close  to  impossi- 
ble, had  not  those  three  books  been  available  to  the  writer.  It  is  the 
writer's  hope  that  this  book  will  further  reduce  the  ruggedness  of  the 
ordeal  without  materially  sacrificing  anything  essential  to  fundamen- 
tal understanding. 

These  prefatory  remarks  would  be  less  than  gracious  were  specific 
tribute  not  paid  to  several  other  people,  all  of  whom  have  left  their 
imprint  upon  this  book. 

Professor  Richard  C.  Henshaw,  Jr.  must,  for  better  or  worse,  bear 
much  of  the  responsibility  for  the  writer's  reflections  appearing  in 
book  form.  It  was  Professor  Henshaw  who  first  exposed  a  group  of 
students  to  these  reflections,  by  requesting  copies  of  the  original 
manuscript  to  be  used  as  a  textbook  in  a  course  of  his  at  Michigan 
State  University,  early  in  1959.  As  a  result  of  this  experience,  Pro- 
fessor Henshaw  was  the  first  person  to  raise  the  question  of  publica- 
tion, and  the  writer  has  further  benefited  substantially  from  Pro- 
fessor Henshaw's  other  suggestions. 

The  writer  is  also  deeply  indebted  to  his  colleague,  Mr.  C.  Ashley 
Wright,  and  to  Professor  Harvey  M.  Wagner  of  Stanford  University. 
Both  Mr.  Wright  and  Professor  Wagner  were  generous  enough  to 
read  the  entire  manuscript,  in  an  effort  to  protect  the  writer  from  his 
own  ignorance.  It  should  be  added,  especially  since  the  writer  has 
not  always  followed  the  excellent  advice  of  Mr.  Wright  and  Professors 
Henshaw  and  Wagner,  that  the  fault  for  any  remaining  manifesta- 
tions of  ignorance  must  be  laid  solely  at  the  writer's  door. 

The  writer's  indebtedness  to  his  secretary,  Miss  Evelyn  T.  Benecke, 
is  no  less  considerable.  Miss  Benecke  nurtured  the  writer's  dreadful 
scrawl  through  the  several  stages  necessary  to  bring  it  to  printed 
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form  with  meticulous  care  and  zealous  interest.  Unquestionably, 
Miss  Benecke's  devotion  to  the  job  both  greatly  reduced  the  chances 
of  typographical  error  and  saved  the  writer  many  hours  of  thankless 
work. 

Finally,  to  lapse  briefly  into  the  first  person  singular,  I  have  dedi- 
cated this  book  to  two  men  widely  known  and  highly  respected  in 
their  own  fields  of  finance  and  geology:  Messrs.  Jay  E.  Crane  and 
Wallace  E.  Pratt,  both  former  Directors  and  Vice  Presidents  of 
Standard  Oil  Company  (New  Jersey).  Over  the  past  fifteen  years, 
these  two  men  have  wielded  a  far  greater  influence  (invariably  for 
the  better)  on  my  activities  and  thinking  than  they  probably  realize ; 
and,  since  both  are  now  retired,  the  bounds  of  propriety  do  not  pre- 
clude my  paying  them  this  small  tribute.  Few  people  I  have  known 
can  rival  these  two  men  either  in  my  affection  for  them  as  persons 
or  in  my  respect  for  their  wisdom. 

E.  G.  Bennion 
Riverside,  Connecticut 
February,  1960 
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CHAPTER  I 

Prologue:  Declamation  and  Orientation 

Linear  programming  and  game  theory  are  important  subjects. 
While  this  has  been  true  since  their  conception  in  an  academic  at- 
mosphere, their  more  recent  use  outside  the  academic  world  consti- 
tutes a  substantially  widened  recognition  of  the  importance  of  these. 
To  the  academician,  linear  programming  and  game  theory  are  viewed 
less  as  decision-making  aids  than  as  analytical  techniques,  while  the 
converse  is  true  for  the  businessman  or  the  war  strategist;  but  the 
importance  is  undeniable  in  either  case. 

The  spread  of  recognition  has  not,  however,  been  anything  like 
synonymous  with  a  spread  of  understanding  of  the  fundamentals  of 
linear  programming  and  game  theory.  Even  in  the  academic  world, 
and  to  a  much  greater  extent  outside  of  it,  the  spread  of  understand- 
ing has  been  confined  to  a  relatively  small  group  of  experts.  This  is 
unfortunate,  in  the  sense  that  it  greatly  limits  the  use  of  these  valu- 
able techniques  in  both  worlds. 

Unfortunate  though  the  relatively  limited  spread  of  understanding 
may  be,  it  is  thoroughly  understandable.  For  however  important 
linear  programming  and  game  theory  may  be,  acquiring  an  under- 
standing of  them  is  undeniably  an  onerous  task  for  the  mathemati- 
cally unsophisticated.  This  is  certainly  not  because  of  a  scarcity  of 
literature  on  these  subjects. 

In  addition  to  the  trail-blazing  works  in  the  fields  of  linear  pro- 
gramming and  game  theory,  there  is  now  available  a  considerable 
number  of  genuinely  excellent  books  that  are  more  expository  in  na- 
ture. Each  of  these  achieves  its  objectives,  and  all  of  these  objectives 
are  desirable.  These  objectives  are  such,  however,  that  either  a 
knowledge  of  the  calculus  or  of  matrix  algebra  (or  both)  on  the  part 
of  the  reader  is  assumed,  or  the  coverage  is  so  thorough  as  to  lead  to 
a  rather  difficult  book  of  quite  substantial  length.  Either  of  these 
courses  makes  the  acquisition  of  an  understanding  of  the  fundamen- 
tals of  linear  programming  and  game  theory,  by  a  mathematically 
unsophisticated  reader,  if  not  an  impossible  task,  certainly  an  ex- 
tremely demanding  one. 
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OBJECTIVE  AND  CONTENT 

This  book  has  the  decidedly  limited  objective  of  making  it  possible 
for  the  reader  with  more  intellectual  curiosity  than  advanced  mathe- 
matical training  to  grasp  the  fundamentals,  or  rationale,  underlying 
linear  programming  and  game  theory.  Its  writing  is  the  result  of  the 
attempt  of  a  mathematical  illiterate  to  teach  himself,  and  a  handful 
of  others,  something  of  this  rationale.  If,  as  is  hoped,  the  result  is  an 
interpretation  essentially  devoid  of  errors,  a  mathematically-minded 
general  reader  can  learn  everything  the  author  knows  with  a  small 
fraction  of  the  effort  he  himself  expended  in  acquiring  it. 

Even  this  elementary  book  cannot  be  read  without  thought,  and 
it  tends  to  become  increasingly  complex  as  it  unfolds.  The  book  is, 
however,  self-contained:  the  mathematically  unsophisticated  reader 
should  be  able  to  understand  it,  without  recourse  to  mathematical 
textbooks  (advanced,  or  otherwise),  if  he  is  willing  to  read  with  care 
and  concentration. 

It  necessarily  follows  that  a  small  book,  concerned  with  only  the 
major  fundamentals,  leaves  a  great  deal  unsaid.  To  cover  what  the 
writer  sees  as  the  major  fundamentals  is  not  to  cover  all  the  impor- 
tant ones,  even  if  the  writer's  view  is  correct.  Furthermore,  a  book 
which  concerns  itself  with  fundamentals  must,  if  it  is  to  remain  both 
small  and  reasonably  comprehensible  to  the  mathematically  unso- 
phisticated, confine  itself  largely  to  the  abstract,  i.e.,  to  small,  in- 
vented problems,  rather  than  to  the  generally  unwieldy  ones  of  real 
life.  In  this  respect,  the  book  reads  like  a  high  school  textbook:  the 
important  generalizations  are  eventually  drawn,  but  only  after  con- 
sidering small  problems  using  specific  coefficients  attached  to  ab- 
stract symbols. 

The  following  section  of  this  chapter  does  pose,  for  orientation  pur- 
poses, a  realistic  problem,  rather  than  one  concerned  with  nameless, 
abstract  symbols;  and  from  time  to  time  in  subsequent  chapters  this 
same  problem  is  developed  further  for  illustrative  purposes,  as  well 
as  to  remind  the  reader  that  abstract  symbols  can  represent  highly 
concrete  things.  But  one  realistic  problem  may  be  worse  than  none, 
if  it  gives  the  reader  the  impression  that  only  a  single-plant  (in  the 
terminology  of  the  economist)  problem  of  a  particular  type  can  be 
solved.  Any  problem  (whether  it  be  one  of  business,  economics,  war, 
or  whatnot),  which  can  be  formulated  in  the  same  general  type  of 
frameworks  as  those  considered  under  linear  programming  and  game 
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theory,  is  a  problem  to  the  solution  of  which  these  techniques  may  be 
able  to  make  a  substantial  contribution.  For  this  reason,  among 
others,  a  genuine  understanding  of  these  techniques  in  the  abstract 
should  be  the  reader's  real  objective.  The  justification  for  an  initial 
realistic  problem  is  simply  to  make  the  transition  to  the  abstract 
relatively  painless. 

One  final  comment  on  the  content  of  this  book  is  in  order.  Short 
though  the  book  is,  the  reader  can  shorten  it  yet  more  without  seri- 
ously impairing  either  his  ability  to  understand  the  remainder  of  the 
book  or  his  understanding  of  the  primary  rationale  underlying  linear 
programming  and  game  theory.  There  is  much  to  be  said  for  the  in- 
clusion of  Chapters  IV  and  V  in  a  book  of  this  sort.  Nevertheless,  the 
reader  can  dispense  with  these  two  chapters  with  but  little  loss  to  his 
understanding  of  rationale.  But  this  carte  blanche  cannot  be  safely 
extended  to  the  reader  who  expects  to  attempt  a  solution  to  problems: 
sooner  or  later  he  will  tangle  with  a  problem  having  no  finite  opti- 
mum, or  with  a  problem  of  potential  degeneracy.  Without  Chapters 
IV  and  V  under  his  belt,  he  will  then  begin  to  wonder  what  has  gone 
wrong  with  his  hard- won  knowledge. 

Having  briefly- considered  the  importance  of  linear  programming 
and  game  theory,  the  principal  objective  of  this  book,  and  the  general 
nature  of  the  book's  content,  the  reader  should  now  be  sufficiently 
interested  (and  softened  up)  to  plunge  headlong  into  linear  program- 
ming. Before  making  this  headlong  plunge,  however,  it  might  be  help- 
ful to  acclimatize  ourselves  a  bit  by  first  dabbling  our  toes  in  the 
waters  of  an  orientation  problem. 

AN  ORIENTATION  PROBLEM 

For  the  mathematically  unsophisticated,  linear  programming  is 
more  readily  understandable  if  the  mathematical  generalizations  are 
preceded  by  relatively  simple  examples.  Unfortunately,  there  are  few 
real  examples  in  as  simple  dimensions  as  are  desirable  for  this  pur- 
pose. To  remedy  this  lack  we  can  fall  back  upon  small  problems  with 
specific  numbers,  but  these  problems  will  still  necessarily  involve 
abstract  symbols  and  not  be  so  obviously  related  to  real  problems. 
For  this  reason,  one  is  likely  to  find  the  trees  obscuring  one's  view  of 
the  forest,  i.e.,  the  relation  of  all  the  details  to  the  end  purpose  may 
not  be  easily  discernible. 

It  seems  sensible,  therefore,  to  begin  our  inquiry  into  linear  pro- 
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gramming  by  considering  a  realistic  problem.  If  we  examine  the  na- 
ture of  such  a  problem,  along  with  a  few  of  the  steps  involved  in 
solving  it,  and  if  we  learn  the  solution  to  that  problem,  even  though 
we  do  not  yet  fully  understand  how  that  solution  is  reached,  con- 
sideration of  little  examples  not  specifically  related  to  some  tangible 
problem  then  becomes  more  meaningful. 

Consider  the  following  concrete  problem.1  A  refinery  produces,  as 
a  by-product,  1,000  gallons  per  hour  of  virgin  pitch  in  its  crude  distil- 
lation operation.  Commercial  fuel  oil,  having  a  realization  (or  sales) 
value  of  5  cents  per  gallon,  can  be  derived  from  the  pitch  in  one  of 
two  ways: 

(1)  The  pitch  can  be  blended  directly  with  flux  stock,  which  has 
a  cracking  value  (and  hence  represents  a  cost)  of  8  cents  per 
gallon,  to  make  commercial  fuel  oil.  The  flux  stock  thus  con- 
stitutes a  cost  of  producing  the  commercial  fuel  oil,  but  we 
arbitrarily  assign  a  zero  cost  value  to  our  by-product,  the  pitch. 

(2)  The  pitch  can  be  blended  indirectly  with  flux  stock,  either 
wholly  or  in  part,  by  being  first  sent  to  a  visbreaker  unit  capa- 
ble of  breaking  the  pitch  (or  visbreaker  feed)  down  into  an 
80  per  cent  yield  of  tar,  which  tar  can  then  be  blended  with 
flux  stock  to  make  commercial  fuel  oil.  The  cost  of  this  addi- 
tional operation,  in  conjunction  with  the  different  viscosity 
and  gravity  blend  numbers  of  the  resultant  tar,2  is  such  that 
we  can  assign  a  zero  value  to  the  tar,  despite  the  fact  that  the 
quantity  of  tar  derived  is  only  80  per  cent  as  great  as  the  quan- 
tity of  pitch.  The  viscosity  and  gravity  blend  numbers  of  the 
pitch,  tar,  and  flux  are  invariant  at  the  figures  shown  in  the 
table  below.  The  viscosity  and  gravity  blend  numbers  of  the 
fuel  oil  can  be  varied  by  varying  the  proportion  of  flux  stock 
used  in  the  blending  process,  but  we  initially  specify  exact  vis- 

1  This  case  is  taken  from  Chapter  2  of  Gifford  H.  Symonds,  Linear  Programming: 
The  Solution  of  Refinery  Problems  (New  York:  Esso  Standard  Oil  Company,  1955). 

2  These  numbers  are  the  result  of  a  technical  definition  (which  need  not  concern  us) 
intended  to  make  possible  the  measuring  of  the  viscous  and  weight  properties  of  petroleum 
products  in  such  a  way  that  both  the  viscosity  and  the  gravity  blend  numbers  of  (say)  two 
products  which  are  blended  can  be  averaged  to  yield  both  the  viscosity  and  the  gravity 
blend  numbers  of  the  product  resulting  from  the  blending  process.  These  numbers  vary 
with  varying  viscosity  and  gravity  in  the  opposite  direction  from  that  which  one  would 
think  most  logical,  i.e.,  the  higher  the  viscosity  and  gravity  blend  numbers,  the  less  viscous 
and  the  lighter  is  the  product — thus  commercial  fuel  oil  both  pours  more  freely  than,  and 
is  lighter  than,  tar;  but  both  the  viscosity  and  the  blend  numbers  of  commercial  fuel  oil 
are  higher  than  those  of  tar. 
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cosity  and  gravity  blend  numbers  for  the  commercial  fuel  oil 
of  21  and  12,  respectively. 

Quantity  Available  Value  Viscosity  Gravity 

{Gallons /Hour)  (Cents /Gallon)         Blend  Number  Blend  Number 

Pitch  P  =  1,000  -  V  0  5  8 

Visbreaker  Feed  V  0 

Tar  T  =  0.8F  0  11  7 

Flux  F  =  any  amount  8  37  24 

Fuel  Oil  P  +  T  +  F  5  21  (minimum)  12  (minimum) 

The  complete  information  at  our  disposal  is  listed  in  the  table 
above.  We  pose  as  our  initial  problem  that  of  determining  the  most 
profitable  mixture  of  pitch,  tar,  and  flux  stock  to  obtain  commercial 
fuel  oil  which  just  meets  the  exact  viscosity  and  gravity  specifica- 
tions. 

The  information  in  the  above  table  provides  us  with  four  require- 
ments equations  (requirements  which  must  be  met  in  the  form  of 
equations) — a  viscosity  requirement  equation,  a  gravity  requirement 
equation,  and  two  material  balance  requirement  equations: 

Viscosity  (3rd  column) :  5P  +  IIP  +  37 F  =  21  (P  +  T  +  F) 

Gravity  (4th  column) :  8P  +    IT  +  24P  =  12(P  +  T  +  F) 

Material  (1st  row  and  column):  P+V  =1,000 

(3rd  row  and  1st  column):     T  =0.87 

To  understand  the  derivation  of  these  equations,  consider  the  vis- 
cosity requirement  equation  of  5P-f-lir+37P  =  21  (P+T+F).  In 
words,  what  this  equation  says  is  that  we  are  required  to  combine  as 
yet  unknown  quantities  of  pitch,  tar,  and  flux  (having  viscosity  blend 
numbers,  respectively,  of  5,  11,  and  37)  in  such  a  way  that  the  result- 
ing blend  (the  P+T+F  on  the  right  side  of  the  equation)  has  a  pre- 
cise blend  number  of  21.  The  gravity  requirement  equation  carries 
an  analogous  message.  The  third  equation  says  we  have  1,000  gallons 
of  pitch,  all  of  which  we  must  use  in  as  yet  unknown  proportions  as 
a  direct  blend  (P)  or  as  an  indirect  blend  (V)  by  sending  it  to  the 
visbreaker  unit  to  break  it  down  into  tar.  The  fourth  equation  merely 
states  that,  whatever  amount  (V)  of  pitch  we  do  send  to  the  vis- 
breaker unit,  the  tar  yield  (T)  will  only  be  80  per  cent  of  that  amount. 
The  coefficients  of  the  above  four  equations  can  be  depicted  in  what 
is  sometimes  called  the  requirements  space,  which  is  here  four-dimen- 
sional (one  dimension  beyond  our  three-dimensional  visualization  ca- 
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pacities).  And  this  requirements  space  is  four-dimensional,  not  be- 
cause we  have  the  four  unknowns  of  P,  T,  F,  and  V,  but  because  we 
have  four  constraints,  or  equations.  More  specifically,  as  will  be  clearer 
from  the  geometric  presentation  of  Chapter  II,  each  set  of  coefficients 
associated  with  a  particular  unknown  variable  can  be  represented 
graphically  as  a  single  point  in  space.  For  example,  the  coefficients 
associated  with  F  in  the  three  equations  on  page  9  of  this  chapter 
are  (—2,  —3,  0);  and  these  coefficients  are  depicted  as  the  single 
point,  Ps,  in  Diagram  5  of  Chapter  II.  Thus  one  needs,  for  such  a 
graphic  presentation,  a  separate  axis  for  each  of  the  coefficients  as- 
sociated with  the  particular  unknown  variable;  and  the  number  of 
these  coefficients  will  necessarily  be  the  same  as  the  number  of  re- 
quirements equations  (hence  the  term  "requirements  space") . 

Similarly,  if  we  wished  to  do  so,  we  could  also  depict  the  values  of 
the  variables  yielded  by  a  solution  to  the  problem  as  a  single  point  in 
what  is  sometimes  known  as  the  solutions  space.  In  this  case,  however, 
we  should  need  a  separate  axis  for  each  of  the  unknown  variables 
(rather  than  for  each  of  the  coefficients  associated  with  a  particular 
variable).  Thus  the  solutions  space  would  be  two-dimensional  for  a 
problem  involving  two  variables,  three-dimensional  for  one  involving 
three  variables,  and  so  on  (hence  the  term  "solutions  space").  As  a 
rule,  and  for  reasons  that  will  soon  become  obvious,  linear  program- 
ming problems  run  to  a  form  in  which  the  number  of  variables  is 
greater  than  the  number  of  requirements  equations:  i.e.,  the  solutions 
space  is  of  higher  dimension  than  the  requirements  space. 

Our  above  table  of  information  can  also  provide  us  with  a  fifth 
equation.  If  our  objective  is  to  maximize  profits  (call  them  Z),  we 
can  say  that  "profits"  will  be  :3 

Z  =  5(P  +  T  +  F)  -  8F(in  cents  per  hour) 

This  equation  says  the  obvious.  To  determine  our  "profits,"  we  must 
first  find  the  sales  value  of  our  commercial  fuel  oil  resulting  from  an 
appropriate  blending  of  pitch,  tar,  and  flux  by  multiplying  the  total 
number  of  gallons  in  that  blend  (P-\-T+F)  by  the  5  cents  per  gallon 
sales  value  of  commercial  fuel  oil.  From  that  figure  for  total  sales 
value,  we  must  then  subtract  our  only  "cost" — namely,  the  number 

3  These  are  not  "profits"  in  the  economists'  sense,  since  our  only  cost  element  is  that 
of  flux  stock.  Subject  to  the  validity  of  our  above  assumptions,  however,  the  "profits" 
functional  will  tell  us  the  comparative  "profits"  figures  (before  all  other  costs,  which  are 
assumed  invariant)  from  varying  the  mixture  of  pitch,  tar,  and  flux  stock. 
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of  gallons  of  flux  (F)  used  in  the  blend  multiplied  by  the  8  cents  per 
gallon  cost  of  flux.  This  will  give  us  our  profits  (Z)  in  cents  per  hour, 
since  the  entire  problem  hinges  on  the  fact  that  the  refinery  produces 
1,000  gallons  of  virgin  pitch  per  hour. 

This  last  equation  above  is  known  as  the  functional,  since  what  we 
seek  to  maximize  (in  this  case,  profits)  is  a  function  of  some  (or  all)  of 
the  unknowns  residing  in  our  solutions  space.  In  other  words,  a  linear 
programming  problem  is  one  of  solving  m  requirements  equations  in 
n  unknowns  in  such  a  way  as  to  maximize  (or  minimize)  a  functiona] 
involving  some  (or  all)  of  the  n  unknowns. 

Our  particular  problem  happens  to  have  four  requirements  equa- 
tions involving  exactly  four  unknowns,  (so  it  is  a  problem  in  which 
m  =  n,  rather  than  m<n),  and  it  has  a  unique  solution.4  This  solu- 
tion is: 

F  =  333 

P  =  -333 

V  =  1,333 

T  =  1,067 

In  other  words,  these  four  values,  and  these  four  values  alone,  will 
satisfy  the  four  requirements  equations. 

This  clearly  constitutes  no  solution  to  the  problem  we  posed.  For 
it  is  certainly  beyond  our  capabilities  to  turn  pitch  into  a  negative 
quantity.  Thus  we  may  also  say  that  solving  a  linear  programming 
problem  involves  solving  m  equations  in  n  unknowns,  not  only  in 
such  a  way  as  to  maximize  the  functional,  but  also  in  such  a  way  as 
to  have  no  negative  unknowns.  This  can  be  done,  but  it  requires  a 
little  contriving. 

In  essence,  this  contriving  involves  turning  our  first  three  require- 
ments equations  into  inequalities,  and  then  introducing  an  additional 
unknown  into  each  inequality  to  return  the  inequality  to  the  form  of 
an  equation.  This  procedure  sounds  a  bit  abstruse,  so  let  us  consider 
what  it  actually  involves  in  this  case. 

By  making  the  right  sides  of  our  viscosity  and  gravity  equations 
equal  to  the  left  sides  of  these  two  equations,  we  were  setting  the 
problem  up  in  such  a  way  as  to  get  an  answer  yielding  the  quantities 
of  pitch,  tar,  and  flux  required  to  meet  certain  exact  viscosity  and 

4  For  those  who  may  have  forgotten,  an  example  of  solving  two  simultaneous  equations 
can  be  found  in  the  second  paragraph  of  the  Matrix  Algebra  Section  of  Chapter  III. 
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gravity  specifications  of  the  product.  If  meeting  these  exact  specifica- 
tions were  our  objective,  and  if  we  substituted  0.8F  for  T  into  the 
viscosity  and  gravity  equations,  we  could  reduce  those  two  equations 
to  the  following  form: 

2P  +  V  -  IF  =  0* 
P  +  V  -  3F  =  0 

Now,  if  we  were  willing  to  let  the  viscosity  and  gravity  specifications 
exceed  the  exact  specifications  initially  set,  the  left  side  of  each  of 
these  last  two  equations  might  be  less  than  zero  by  some  (as  yet  un- 
known) amount— say  yx  for  the  viscosity  equation  and  y2  for  the  grav- 
ity equation.  To  admit  the  possibility,  therefore,  of  such  excess  over 
the  initial  exact  specifications,  we  should  have  to  rephrase  these  last 
two  equations  to : 

IP  +  V  -  IF  +  yi  =0 

P+V-3F  +y2  =  0 

To  illustrate  again  with  reference  to  the  above  viscosity  requirement 
equation,  this  equation  derives  from  our  saying  that,  if  we  are  willing 
to  exceed  the  initial  specification  of  an  exact  viscosity  of  21  for  com- 
mercial fuel  oil,  then  2P+F-2F<0.  If  the  left  side  of  this  inequa- 
tion does  turn  out  to  be  <0,  rather  than  =0,  we  need  to  know  by 
how  much  it  is  less  than  zero,  to  determine  the  amount  by  which  we 
must  exceed  the  viscosity  of  21  initially  set.  This  as  yet  unknown 
amount  we  label  as  ylf  and  yx  must  necessarily  be  either  positive  or 
zero.  Consequently,  the  inequation  of  2P+V-2F<0  can  be  stated 
in  the  form  of  an  equation  of  2P+V—2F+y1  =  0J  where  yi>0. 

By  the  same  token,  there  is  nothing  sacred  about  our  making 
P+V= 1,000.  If  we  can  maximize  profits  better  by  making  P+V 
<  1,000  (i.e.,  by  throwing  away  part  of  the  1,000  gallons),  we  are 
certainly  free  to  do  so.  Consequently,  our  first  material-balance-re- 

*  Consider,  for  example,  the  initial  viscosity  requirement  equation: 

(a)  5P+11T+37F=21(P+T+F). 
Transposing  the  left  side  to  the  right  side,  we  get: 

(b)  16P+10r-16F=0. 
Substituting  0.8F  for  T,  we  have: 

(c)  16P+8F-16F=0. 
And  dividing  through  by  8: 

(d)  2P+V-2F=0. 

Thus,  equation  (d)  is  the  equivalent  of  equation  (a). 
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quirement  equation  now  takes  the  form  of: 

P  +  V  +  yz  =  1,000, 

where  y3  is  the  (as  yet  unknown)  amount  of  the  1,000  gallons  we 
throw  away.  Consequently,  we  emerge  with  a  system  of  three  equa- 
tions in  six  unknowns: 

2P+V-2F  +  yi  =0 

P+V  -3F  +y2  =0 

P  +  V  +  y3  =  1,000 

while  our  functional  for  maximizing  profits  remains  the  same  as  be- 
fore: 

Z  =  5P  +  4F  -  3F 

Our  new  problem  has  thus  become  one  of  finding  non-negative 
values  for  the  six  variables  P,  V,  P,  yh  y2,  and  y3  which  will  satisfy 
the  three  requirements  equations  in  such  a  way  as  to  maximize  our 
functional.  If  there  is  such  a  non-negative  solution  to  these  three 
equations,  it  is  highly  probable  that  there  is  an  infinite  number  of 
non-negative  solutions  (for  a  unique  solution  to  a  system  of  equations 
rarely  exists,  except  when  the  number  of  unknowns  exactly  equals 
the  number  of  equations),  and  ours  is  the  task  of  finding,  in  that  in- 
finite number  of  solutions,  the  particular  solution (s)  which  will  maxi- 
mize the  profit  function. 

Such  is  the  general  nature  of  the  linear  programming  problem. 
And,  in  our  specific  example,  the  optimal  solution  is  actually : 

P  =  0,     yx  =  0;     ;y3  =  0;     V  =  1,000;     F  =  500;     y2  =  500 

In  words,  this  solution  tells  us  this: 

(1)  Since  P=0,  y3  =  0  and  V=  1,000,  all  of  the  pitch  should  go  to 
the  visbreaker  unit  to  yield  800  gallons  per  hour  of  tar  (remem- 
ber, r=0.8F). 

(2)  Since  P  =  500,  the  800  gallons  of  tar  should  then  be  blended 
with  500  gallons  of  flux  to  obtain  commercial  fuel  oil. 

(3)  Since  yi  =  0,  the  minimum  viscosity  specification  is  in  fact  met. 

(4)  Since  3/2  =  500,  the  minimum  gravity  specification  is  exceeded. 
(In  fact,  it  is  exceeded  by  a  shade  more  than  1.5  points,  since 
the  flux  part  of  the  blend  is  5/13  and  has  a  gravity  of  24,  while 
the  tar  part  of  the  blend  is  8/13  and  has  a  gravity  of  7,  which 
results  in  a  fuel  oil  gravity  of  13.5-f-). 
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(5)  And  from  our  functional  Z=5P+4F-3F=0+4,000- 1,500 
=  2,500,  profits  are  maximized  at  $25per  hour. 

There  is  no  doubt  about  this  constituting  the  optimal  course  of 
action,  but  even  in  this  simple  little  case  it  is  by  no  means  obvious 
that  this  is  so,  without  first  resorting  to  linear  programming  methods 
both  to  discover  and  to  prove  it  the  optimal  course.  It  is  the  purpose 
of  the  next  two  chapters  to  consider  something  of  those  methods  and 
their  rationale,  using  still  simpler  examples  of  a  necessarily  abstract 
nature  to  illustrate  the  methods  and  rationale.  After  this  initial  sortie 
into  the  abstract,  we  should  be  able  to  return  to  the  blending  problem 
(at  the  end  of  Chapter  II)  and  see  the  true  nature  of  it  more  clearly. 
Actual  solution  of  this  particular  problem  will  be  found  in  the  first 
section  of  Chapter  VI,  where  it  is  used  to  illustrate  duality. 


CHAPTER  II 
Elementary  Concepts  Visualized 

In  this  chapter  we  shall  be  largely  concerned  with  laying  a  geo- 
metric foundation  in  two-  and  three-dimensional  pictures,  in  order 
that  we  may  ultimately  visualize  something  of  the  nature  of,  and  the 
solution  to,  linear  programming  problems.  But  it  is  desirable  to  begin 
by  stating  in  a  completely  general  form  what  we  now  know  to  be  the 
linear  programming  problem.  A  mathematical  generalization  of  our 
specific  blending  problem  would  be : 

(1)  To  solve  the  following  system  of  m  inequalities  in  n  unknowns:1 

^11^1    +  ^12^2    +    '••■+  ainjn    <  fa 
(hiyi    +  022^2    +    •    •    •    +  Chnjn    <  fa 

dmljl  +  Ciml J!  +    '    *    '    +  CLmnyn  <  #m 

which  system  we  can  turn  into  the  following  system  of  m  equa- 
tions in  (n+m)  unknowns: 

anyi  +  a^y%  +  •'••.+  ainyn  +  yn+i  =  fa 

<hiyi  +  022y2  +  ■  •  •  4-  02nyn  +  yn+2  =  fa 

dmiyi  +  On&y*  +  •  •  •  +  amnyn  +  yn+m  =  bm 

this  latter  system  to  be  solved  in  such  a  way  as : 

1  There  is  a  reason  for  the  seemingly  perverse  insistence  upon  using  the  letter  y  (rather 
than  the  more  natural  letter  x)  in  the  preceding  chapter,  in  this  chapter,  and  in  many  other 
places  in  this  book.  Matrix  algebra  convention  is  to  let  the  first  subscript  of  the  coefficients 
represent  row  number  and  to  let  the  second  subscript  represent  column  number — as  is 
done  here.  But  there  is  a  relationship  between  linear  programming  and  game  theory;  and 
in  game  theory,  as  we  shall  see  in  Chapters  VII  to  IX,  the  letter  y  is  customarily  associated 
with  Player  B  and  with  the  matrix  of  coefficients  in  such  a  way  as  to  give  us  an  implicit 
system  of  equations  in  which 

n 

2Z  aayi  ^  V        (where  rj  =  "the  value  of  the  game"), 
j=i 

for  all  i=  1,  •  •  •  ,  m.  This  is  the  same  general  type  of  inequality  as  that  with  which  we  are 
here  concerned:  namely,  a  system  of  inequalities  in  which  the  left  side  is  <  the  right  side, 
and  the  jth  y  is  associated  with  thejth  column  of  the  matrix.  The  letter  x  is,  on  the  other 
hand,  associated  with  the  transpose  (explained  in  Chapter  VI)  of  this  "original"  matrix  of 
coefficients  and  involves  a  system  of  inequalities  in  which 

m 

X]  aijXi  >  ?7,  for  all/  =  1,  •  •  •    n 

so  the  ^th  x  is  associated  with  the  ith.  row  of  the  wwtransposed  matrix.  This  latter  system 
of  inequations  is  conventionally  associated,  in  game  theory,  with  Player  A. 
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(2)  To  have  all  components  of  y=  (yh  y2,  •  •  .  ,  yn+m)  non-negative 
(i.e.,  either  zero  or  positive)  and 

(3)  To  maximize  (or  minimize)  some  function  of  y 

f(y)  =  ciy±  +  •  •  •  +  Cnyn 
The  first  number  of  the  subscripts  for  the  coefficients,  a,  and  the 
subscript  for  the  coefficients,  b,  merely  stand  for  the  row  number  (or 
equation  number)  in  which  those  coefficients  appear.  And  the  second 
subscript  number  of  the  coefficients,  a,  simply  stands  for  the  column 
number  (or  particular  y)  with  which  those  coefficients  are  identified. 
Thus,  amn  represents  the  number  in  the  mth  row  (or  equation)  asso- 
ciated with  the  nth  y,  which  naturally  appears  in  the  nth  column. 
And  bm  simply  stands  for  the  number  on  the  right  side  of  the  mth 
equation. 

Now  the  purpose  of  first  steeping  ourselves  in  this  symbolic  state- 
ment of  the  linear  programming  problem  is  not  to  state  an  under- 
standable problem  in  language  difficult  to  understand— for  a  symbolic 
statement  is  difficult  to  grasp,  until  one  has  digested  the  meaning  of 
the  symbols.  Rather,  the  purpose  is  to  impress  upon  our  minds  that 
the  examples  considered  here  in  two  equations  and  three  unknowns, 
and  in  three  equations  and  four  unknowns,  could  just  as  readily  be 
examples  in  a  hundred  (or  in  m)  equations  in  two  hundred  (or  in  n) 
unknowns.  To  confine  ourselves  to  two  or  three  dimensions  simply 
avoids  unnecessary  and  tedious  labor,  while  also  keeping  us  within 
dimensions  we  can  readily  visualize.2 

2  While  we  cannot  visualize  beyond  three  dimensions,  ^-dimensional  space  is  merely  an 
abstraction  involving  a  logical  extension  of  concepts  and  definitions  applicable  to  dimen- 
sions within  our  capacity  to  visualize.  We  know  from  elementary  analytical  geometry  and 
the  Pythagorean  theorem,  for  example,  that,  if  we  have  two  points  in  two-dimensional 
space 

Pi  =  (fli,  a2)  =  (5,  1) 

P2  =  (bh  h)  -  (1,  4) 

the  linear  distance  between  Px  and  P2  can  be  thought  of  as  the  hypotenuse  of  a  right  tri- 
angle so  that 

d(P1}  P2)  =  V(fli  -  hY  +  (02  -  hY  =  V(5  -  l)2  +  (1  -  4)2  =  5 
It  is  also  easy  to  see  that,  if  our  two  points  happen  to  be  in  a  three-dimensional  figure  so  that 

Pi  =  (ah  (h,  a3) 

P2  =  (bit  K  fa), 
the  linear  distance  from  Px  to  P2  will  be 

d(Ph  P2)  =  V(0i  -  hY  +  (a2  -  h¥  +  (a,  -  b3Y 
Beyond  three  dimensions,  therefore,  it  is  logical  to  extend  this  definition  of  distance  be- 
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The  easiest  way  to  visualize  what  is  entailed  in  finding  the  opti- 
mum solution  to  a  set  of  equations  having  more  unknowns  than  equa- 
tions is  to  begin  with  a  visualization  of  the  solution  to  a  set  of  equa- 
tions having  the  same  number  of  unknowns  as  equations.  We  shall 
get  a  unique  solution  to  this.3  Then  we  can  add  another  unknown 
without  increasing  the  number  of  equations.  We  shall  discover  that 
we  shall  have  an  infinite  number  of  solutions  to  this  latter  problem, 
and  that  we  can  actually  visualize  these,  as  long  as  we  do  not  let 
the  number  of  requirements  equations  exceed  three.  We  shall  also  dis- 
cover that  there  is  a  point  where 

1 

=  a  maximum, 


yi  +  j2  +  yz 
as  well  as  a  point  where 

1 


yi  +  yi  +  yz 


=  a  minimum; 


and  these,  too,  we  shall  be  able  to  visualize.  By  that  time,  we  shall  be 
getting  close  to  the  fundamentals  of  linear  programming. 

N  EQUATIONS  IN  N  UNKNOWNS 

Anyone  who  has  had  elementary  algebra  has  solved  a  pair  of  equa- 
tions in  two  unknowns  such  as 

4yi  +    yi  =  5 
2yi  +  3y2  =  6 

This  system  has  a  unique  solution,  and  this  solution  happens  to  in- 
volve only  positive  components  for  y—(yi,  y2).  This  unique  solution 
isyi  =  9/10,  y2=7/5. 

We  can  draw  a  two-dimensional  (plane)  picture  of  this  problem  and 
its  solution.  The  three  pairs  of  coefficients  associated  with  yx  (4,  2) 
and  y2  (1,  3)  and  constituting  the  right  sides  of  the  two  equations 
(5,  6)  can  be  thought  of  as  three  points  in  two-dimensional  space.  So 
we  plot  these  three  points  and  label  them  as  Pi  and  P2  (to  indicate 

tween  two  points  to 


d(Pi,  P2)  =  V(ax  -  hY  +  (a,  -  h)*  +  •  •  •  +  (an  -  bn)\ 

even  though  we  cannot  visualize  this  distance  in  any  natural  manner. 

3  Having  the  same  number  of  equations  as  variables  does  not  necessarily  guarantee  this 
result,  but  this  will  be  true  for  the  examples  we  use. 
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that  these  two  points  are  associated  with  yx  and  y2,  respectively)  and 
as  P0,  as  shown  in  Diagram  1. 

When  one  solves  these  equations  for  yx  and  y2)  what  one  is  really 
doing  is  finding  the  (unique)  values  for  yx  and  y2  which  can  be  multi- 
plied by  Pi  and  P2,  respectively,  to  yield  P0.  If  we  wish,  therefore,  we 
can  also  plot  Pxyx  [which  is  9/10  of  (4,  2),  or  (18/5,  9/5)]  and  P2y2 
[which  is  7/5  of  (1,  3),  or  (7/5,  21/5)].  The  sum  of  these  is  (25/5, 
30/5)  =  (5,  6)  =  P0,  as  it  should;  and  one  can  intuitively  sense  that  the 
parallelogram  completed  by  the  broken  lines  shows  our  solution  is 
unique:  i.e.,  that  the  distances  from  the  origin  to  Piyi  and  to  P2y2 
must  equal,  respectively,  the  distances  from  P2y2  and  Piyx  to  P0,  and 
only  one  pair  of  values  for  yx  and  y2  will  do  this. 

DIAGRAM     I 


Pn  =(5,6) 


Next,  suppose  we  draw  a  straight  line  from  the  origin  of  our  dia- 
gram through  P0  and  define 

1 
a  = 


so  that,  in  this  case, 


y\  +  y2 


1 


9/10  +  7/5 


10/23. 


This  line  through  P0  will  intersect  the  straight  line  joining  Px  and 
P2ataP0 
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(i.e.,  at  the  point, (P0),  or  at  10/23  P0 ) . 

\  yi  +  j2  / 

In  words,  the  point  at  which  the  ray  through  P0  intersects  the  line 
joining  Pi  and  P2  is  P0  multiplied  by  the  reciprocal  of  yi+y2  and  the 
more  general  definition  of 


yi  +  •  •  •  +  ^n+m 


constitutes  a  concept  of  real  value  in  understanding  the  general  na- 
ture of  solutions  to  linear  programming  problems. 

We  might  note  one  other  thing  of  importance  about  this  diagram. 
If  the  ray  through  P0  does  not  intersect  the  line  joining  P±  and  P2, 
there  is  no  all-non-negative-components-of-y  solution  to  the  problem. 
For  example,  if  P0  were  changed  to  (5,  2),  the  ray  running  from  the 
origin  through  the  new  P0  would  lie  below  the  line  drawn  from  the 
origin  through  Pi  and  could  not  intersect  the  line  joining  Pi  and  P2. 
This  is  because  a  negative  component  of  y  enters  into  the  solution  of 
this  pair  of  equations.  In  fact,  with  P0=(5,  2),  the  solution  is 
y=(yi,  y2)  =  (13/10,  — 1/5).  This  is  a  type  of  solution  not  permissible 
within  the  linear  programming  framework. 

Moving  to  three  equations  in  three  unknowns  gives  us  the  same 
general  type  of  picture,  except  that  it  is  in  one  higher  dimension.  If 
we  solved  the  system 

4yi  +  y%  +  2y3  =  10 
Syi  +  2^2  +  3yz  =  10 
2yi  +  Sy2  +  2y3  =  8, 

we  should  get  the  unique  solution  of  3^ =9/5,  ^2  =  4/5,  ;y3=l. 

We  can  depict  the  four  points  in  three  dimensions  of  Pi=  (4,  3,  2), 
P2=  (1,  2,  3),  P3  =  (2,  3,  2),  and  P0=  (10,  10,  8)  in  a  three  dimensional 
diagram  such  as  Diagram  2.  We  can  think  of  these  points  as  the  heads 
of  four  pins  standing  in  an  open-front  box.  The  lower  left  corner  at 
the  back  of  the  box  represents  the  origin,  the  lower  back  edge  is 
axis  1,  the  lower  edge  of  the  left  side  is  axis  2,  and  the  vertical  edge 
rising  from  the  origin  is  axis  3.  Then  the  pin  the  head  of  which  repre- 
sents P0,  for  example,  is  placed  so  its  point  on  the  bottom  of  the  box 
is  10  units  to  the  right  of  the  origin  and  10  units  forward  from  the 
lower  back  edge,  while  the  pin  rises  8  units  directly  above  this  point, 
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m  DIAGRAM   2 


so  that  the  pinhead  constitutes  a  point  in  three-dimensional  space 
representing  the  coordinate  values  of  (10,  10,  8). 

Next  we  join  Ph  P2,  and  P3  with  straight  lines  to  give  us  a  two- 
dimensional  triangular  plane  supported  in  three-dimensional  space 
by  its  three  pins.  Finally,  we  draw  a  ray  from  the  origin  through  P0, 
and  note  that  this  ray  passes  through  the  triangular  plane  at  one 
point.  As  we  did  in  our  two-dimensional  Diagram  1,  we  could  also 
plot  the  points  (Piyi,  P2y%,  and  P3y3)  whose  three-dimensional  values 
would  naturally  sum  to  P0=  (10,  10,  8) ;  but  this  would  unnecessarily 
clutter  up  an  already  busy  diagram. 

The  important  similarities  between  this  diagram  and  the  preceding 
two-dimensional  one  are  fairly  obvious.  For  an  all-non-negative-com- 
ponents solution  for  y,  the  ray  through  P0  must  pass  at  a  single  point 
through  the  linear  or  plane  figure  delineated  by  the  points  represent- 
ing the  coefficients  of  the  components  of  y — a  straight  line  in  Dia- 
gram 1  and  a  triangle  in  Diagram  2.  And  in  both  cases,  this  point  is 
aPo,  with  a  being  the  reciprocal  of  the  sum  of  the  components  of  y 
representing  the  unique  solution  to  the  set  of  simultaneous  equations. 

While  we  can  push  visualization  of  the  entire  problem  no  further 
than  three  dimensions,  with  a  mixture  of  a  little  algebra  and  intuition 
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we  can  see  that  the  conclusion  most  vital  to  us  holds  for  all  dimen- 
sions. We  know  that  in  Diagram  1, 

2 

Po  =  Piyi  +  P2;V2  =   X)  Pjyj 

3=1 

and  in  Diagram  2, 

3 

Po  =  Piyi  +  ^2^2  +  P*y*  =   E  P;3V- 
So  we  can  always  say  that 

n—m 

Po=  T,Pjyh 

3=1 

no  matter  what  the  dimension  of  each  Pj,  i.e.,  no  matter  how  many 
rows  of  coefficients  each  Pj  includes.  Consequently,  we  will  always 
have  a  single  "point"  in  n  =  m  dimensions  representing 

n=m 

aP0  =  a  X  PjJh 
y=i 

and  a  will  represent  the  proportion  of  the  "distance"  (in  the  sense 
indicated  in  footnote  2)  that  <xP0  lies  from  the  origin  towards  P0. 
Thus,  in  Diagrams  1  and  2,  aP0  is  10/23  and  5/18,  respectively,  of 
the  way  towards  P0.*And  in  both  cases,  as  would  also  be  true  for  any 
dimension  involving  an  equal  number  of  equations  and  unknowns, 
we  get  but  a  single  point,  aP0.  But,  as  we  shall  shortly  see,  when  we 
have  more  unknowns  than  equations,  we  may  get  an  infinite  number 
of  qlPq's  located  on  a  straight  "line,"  and  one  of  these  will  be  a  mini- 
mum aP0  and  one  will  be  a  maximum  aP0. 

M  EQUATIONS  IN  N  UNKNOWNS4 

When  we  admit  more  unknowns  than  we  have  equations  into  our 
system,  we  take  an  important  step  towards  understanding  the  prob- 
lem of  linear  programming.  We  can  easily  illustrate  this  by  adding  a 
third  unknown  (and  coefficients  for  it)  to  the  simple  example  depicted 
in  Diagram  1,  to  get: 

4ji  +    ;y2  +  3y3  =  5 
2yi  +  Sy2  +  5y3  =  6 

4  While  the  typical  linear  programming  problem  is  initially  in  terms  of  requirements 
inequalities,  in  the  interests  of  greater  simplicity,  most  of  our  problems  will  be  in  terms  of 
equations.  As  we  have  already  seen,  it  is  easy  to  turn  the  typical  inequalities  into  equa- 
tions; but  this  unnecessarily  complicates  the  picture  for  us  by  resulting  in  additional 
variables. 
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This  is  a  problem  still  having  a  two-dimensional  requirements  space, 
because  the  requirements  to  be  met  are  still  stated  in  only  two  equa- 
tions. But  the  solutions  space  has  been  increased  to  three  dimensions, 
because  we  now  have  three  unknowns,  and  if  we  wanted  to  depict  the 
solution,  y=(yi,  y2}  ys)  as  a  point  in  space,  we  could  do  so  only  in  a 
diagram  having  three  coordinates. 


DIAGRAM 


One  need  not  be  a  polished  mathematician  to  see  that  this  pair  of 
requirements  can  be  met  in  more  than  one  way.  We  can,  for  example, 
set  any  one  of  the  three  unknowns  equal  to  zero,  and  solve  for  the  re- 
maining two;  so  there  are  three  solutions  involving  one  zero  com- 
ponent for  y=  (y1}  y2,  y3).  These  solutions  are: 

y  =  (yi,  y%,  y*)  =  (o,  -  7/4,  9/4) 
y  =  (yi,  y*>  y%)  =  ttA  o,  l) 
y  =  (yi,  *,  yD  =  (9/io,  7/5,  o) 

The  first  of  these  is  not  acceptable  for  our  purposes,  since  it  involves 
the  negative  component,  y2=  —  7/4,  but  the  other  two  are  acceptable. 
Furthermore,  there  is  an  infinite  number  of  solutions  involving  posi- 
tive values  for  all  three  components.  For  example,  y=(yi,  y2,  3^3) 
=  (7/10,  7/10,  1/2)  will  satisfy  both  requirements.  How,  then,  do  we 
choose  the  "best"  solution  from  the  infinite  number  of  solutions? 
The  best  solution  will  depend  on  more  than  the  requirements  equa- 
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tions;  it  will  also  depend  on  the  functional  to  be  maximized  (mini- 
mized). With  the  simplifying  assumption  that  we  wish  to  maximize 
yi+^2+^3,  the  way  is  clear,  if  we  draw  a  two-dimensional  picture  of 
the  problem  as  is  done  in  Diagram  3.  This  diagram  differs  materially 
from  Diagram  1  only  in  that  it  has  the  additional  point,  Ps=(3,  5), 
but  this  additional  point  has  drastically  altered  the  nature  of  the 
solution.  The  unique  solution  of  Diagram  1  is  still  a  solution;  in  fact, 
it  is  the  solution  which  minimizes  a — and,  therefore,  which  maximizes 
(yi+y*+ys)  =  9/10+  7/5+0)  =  23/10,   since  a  is  the  reciprocal  of 

But  the  solution  y=(y1}  y2,  y9)  =  (l/2,  0,  1)  is  also  a  solution;  and 
this  is  the  solution  which  maximizes  a — and,  therefore,  minimizes 
(yi+y2+ys)  =  (1/2+0+1)  =  3/2.  And  the  entire  line  segment  lying 
between  amP0  and  aMPo  represents  an  infinite  number  of  solutions 
with  all  three  components  of  y  positive;  but  each  of  these  will  have  a 
sum  for  the  components  of  y  which  is  smaller  than  for  those  of  am  and 
larger  than  for  those  of  aM.  Thus,  y=(yh  y2,  ys)  =  (7/10,  7/10,  1/2) 
means  an  aP0  of  10/19  P0,  and  23/10 >  19/10 >  3/2.  If  the  functional 
in  our  linear  programming  problem  told  us  to  maximize  (or  minimize) 

*     f(y)  =  yi  +  y*  +  ys, 

we  could  clearly  put  our  hands  on  the  answer  to  it,  in  this  problem, 
in  a  hurry:  it  would  be  the  y  components  associated  with  am  (or  aM). 

Nor  would  the  introduction  of  additional  unknowns  into  our  two 
equations  result  in  any  new  complications.  If,  for  example,  we  had 
1a.ve  unknowns,  Diagram  3  would  simply  show  the  aP0  ray  passing 
through  a  pentagon  (and  cutting  it  at  just  two  points),  instead  of 
through  a  triangle.  But,  of  course,  it  is  always  true  that,  for  an  all- 
non-negative-components  solution  of  y  to  exist,  P0  must  be  so  situated 
that  the  aPQ  ray  does  not  fail  to  cut  through  the  convex  set  of  points 
delineated  by  the  triangle,  pentagon,  or  other  figure  described  by  the 
points  (i.e.,  columns  of  coefficients)  on  the  left  side  of  the  equations. 

Moving  to  a  three-dimensional  requirements  space  and  a  four-di- 
mensional solutions  space  results  in  similar  conclusions.  This  we  can 
easily  visualize  by  merely  adding  another  unknown  to  the  problem 
illustrated  in  Diagram  2,  to  get  the  system: 

4yi  +  y2  +  2y3  +  3y4  =  10 
3yi  +  2y2  +  3ys  +  4y4  =  10 
2yi  +  Sy2  +  23/3  +  3y4  =  8 
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This  system  has  two  solutions  involving  a  zero  value  for  one  of  the 
components  of  y  and  positive  values  for  the  three  remaining  com- 
ponents. These  solutions  are: 

y  =  fa,  3*1  y*>  yd  =  (8/5,  3/5,  o,  i) 
y  =  (yi,  3*,  y»i  yO  =  (9/5, 4/5,  i,  o) 

Diagram  4  shows  the  points  Plf  P2,  P3,  and  P4  in  the  same  three- 
dimensional  setting  as  was  used  in  Diagram  2.  If  all  four  of  these 

DIAGRAM    4 


H. 


P0»(  10,10,8) 


points  were  joined  by  straight  lines  (P3  and  P4  are  purposely  not 
joined  in  order  to  avoid  unnecessarily  complicating  the  picture),  they 
would  form  a  three-dimensional  figure  in  the  form  of  a  tetrahedron 
suspended  in  the  box. 

With  P3  and  P4  not  joined,  we  can  imagine  ourselves  looking  into 
the  jaws  of  a  sort  of  triangular-shaped  trap.  The  hinge  of  the  trap  is 
the  broken  line  joining  Px  and  P2,  the  upper  jaw  of  the  trap  (the 
bottom  of  which  we  are  seeing)  is  formed  by  the  triangle  PiP2P4,  and 
the  lower  jaw  of  the  trap  (the  top  of  which  we  are  seeing)  is  formed 
by  the  triangle  PiP2P3.  As  the  ray  through  P0  travels  up  from  the 
origin,  it  disappears  from  our  view  behind  the  lower  jaw,  and  then  it 
reappears  as  it  first  pierces  the  tetrahedron  on  the  plane  triangular 
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surface  of  P1P2P3.  This  point  is  amP0  =  5/18  P0.  As  we  know,  am  im- 
plicitly carries  the  unique  solution  for  y=  (yh  y2,  y3)  =  (9/5,  4/5,  1)  of 
our  problem  in  Diagram  2;  although,  in  the  expanded  problem  of 
Diagram  4,  we  really  have  that  y=(yh  y2,  y3y  yi)  =  (9/5,  4/5,  1,  0). 
This  is  the  point  at  which  (yi+y2+ys+yi)  =  (9/5+4/5+ 1+0)  =  18/5 
is  maximized. 

As  the  ray  continues  up  towards  P0,  we  see  it  disappear  (briefly)  at 
the  point  where  it  cuts  through  the  bottom  side  of  the  plane  triangu- 
lar surface  described  by  P1P2P4.  This  is  the  point  of  aMPo  =  5/16  P0; 
and  this  is  the  point  where 

1  1 

a  = = =  5 /16 

yi  +  yi  +  yz  +  y4     8/5  +  3/5  +  0  +  1 

or  the  point  at  which  the  sum  of  (^1+^2+^3+^4)  is  minimized  at  16/5. 
As  we  might  now  surmise,  the  line  segment  of  the  ray  through  P0 
which  lies  between  amPo  and  aMPo  represents  the  infinite  number  of 
solutions  involving  positive  values  for  all  four  components  of  v;  but, 
in  each  of  these  cases,  the  sum  of  these  four  components  will  be 
smaller  than  those  involved  in  am  and  larger  than  those  involved 
in  aM- 

We  might  note  one  further  rather  obvious  similarity  between  Dia- 
grams 2  and  4.  In  Diagram  2,  the  ray  through  P0  does  not  cut  the  line 
joining  P2  and  P3;  and,  in  Diagram  4,  the  ray  does  not  cut  either  of 
the  two  triangular  planes  formed  by  P2,  P3)  and  P4  and  by  Ph  P3, 
and  P4.  In  all  cases,  this  is  because  a  solution  involving  only  the  com- 
ponents of  y  associated  with  these  particular  points  would  result  in 
at  least  one  negative  component — an  unacceptable  solution  for  linear 
programming  purposes. 

THE  BLENDING  PROBLEM  AGAIN 

Let  us  now  reconsider  the  blending  problem  of  Chapter  I.  To  do  so 
will  serve  three  useful  purposes:  (1)  it  will  provide  us  with  an  illustra- 
tion of  what  we  have  just  considered  somewhat  in  the  abstract;  (2)  it 
will  emphasize  how  cumbersome  even  a  relatively  simple  problem  in 
linear  programming  can  be;  (3)  it  will  serve  to  illustrate  the  nature 
and  importance  of  the  next  step  towards  an  understanding  of  the 
rationale  underlying  the  solution  of  linear  programming  problems. 

In  originally  stating  the  blending  problem,  we  used  certain  mne- 
monic symbols  in  the  equations:  P  for  pitch,  V  for  visbreaker  feed, 


22  LINEAR  PROGRAMMING  AND  GAME  THEORY 

and  F  for  flux.  To  these  we  added  three  giveaway  factors  (i.e.,  factors 
involving  actual  or  potential  relaxation  in  the  requirements  equa- 
tions' stringency),  and  we  labeled  these  as  yh  y2,  y*.  Visualizing  this 
problem  will  be  less  confusing,  if  we  now  use  y  components  through- 
out, so  that: 

yi  =  pitch  (formerly  labeled  P) 
/y2  —  visbreaker  feed  (formerly  labeled  V)   y^° 
yfyi  =  flux  (formerly  labeled  F)       £©© 

3>4  =  viscosity  giveaway  factor  (formerly  labeled  yi) 
y%  =  gravity  giveaway  factor  (formerly  labeled  y2)  4*0 

y&  =  materials  giveaway  factor  (formerly  labeled  y3) 

Stating  the  problem  in  these  symbols,  we  have: 

(1)  Maximize: 

z  =  5yi  +  4y2  —  3y3 

(2)  Subject  to  the  requirements  that: 

2yi  +  y2  -  2y3  +  y4  =0 

3>i  +  y*  —  Sys  +  y5  =0 

yi  +  yi  +  y&  =  1,000 

This  restatement  of  the  equations  makes  it  possible  to  depict  the 
problem  in  three-dimensional  points  and  automatically  know  which 

6 

Pi 

=1 
represents  the  column  of  three  coefficients  associated  with  which 

6 

=1 

Thus,  for  example,  we  shall  immediately  know  that  Pi  represents  the 
three  coefficients  of  yi,  and  so  on. 

The  six  points  representing  the  six  sets,  or  column  vectors,  of  three 
coefficients  associated  with 

6 

yi 
=1 

are  plotted  in  Diagram  5.  In  this  diagram,  the  origin  has  been  placed 
at  the  lower  left  front  corner,  so  that  higher  values  for  axis  2  now  run 
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DIAGRAM    5 

m 

P0 '(0,0,1 000) 


-1.     * 


-  6 


P3=  (-2.-3,0) 


from  front  to  back,  rather  than  the  reverse  (as  was  the  case  in  Dia- 
grams 2  and  4).  This  change  in  the  position  of  the  origin  makes  it 
easier  to  visualize  this  particular  problem.  It  should  be  noted  that  P0 
lies  directly  above  the  origin,  so  that  the  vertical  axis  is  also  the  ray 
through  P0.  But  P0  itself  does  not  show  in  the  diagram,  since  the  dia- 
gram would  have  to  be  many  times  taller  to  include  P0,  unless  we 
reduced  the  scale  to  a  point  where  we  could  not  visualize  the  impor- 
tant things.  Note  that  we  also  have  another  new  wrinkle  in  this  dia- 
gram: a  point  (P3)  with  two  negative  coordinates,  although  this  in- 
troduces no  new  problems. 

Now  an  optimum  solution(s)  to  this  problem,  if  a  solution  exists 
(as  we  have  already  been  told  it  does),  will  exist  in  m  positive  com- 
ponents of  y  (3  components,  in  this  case),  with  the  remaining 
(n+m-m)  components  (3+3-3  =  3,  in  this  case)  being  zero.5  The 

5  Even  this  cannot  be  accepted  as  a  universal  truth.  One  of  several  complications,  the 
resolutions  of  which  are  considered  in  Chapters  IV  and  V,  is  what  to  do  when  we  bump  into 
a  case  of  so-called  degeneracy— a  case  in  which  we  encounter  a  solution  involving  less  than 
m  positive  components  for  y,  with  the  remaining  components  being  zero.  For  example,  if 
we  changed  the  P0  of  Diagram  4  from  (10,  10,  8)  to  (10,  10,  10),  the  ray  through  P0  would 
not  go  through  the  tetrahedron,  but  it  would  just  touch  the  common  side  of  triangles 
P1P2P3  and  P1P2P4,  giving  a  solution  in  yi  and  y2  alone.  Unless  the  solutions  space  in- 
volved more  than  four  unknowns  (and,  therefore,  more  than  the  four  points, 

4 

Pi 
M 

of  Diagram  4)  this  would  be  the  only  solution  to  our  problem,  even  though  that  solution 
does  involve  but  two  positive  components  for  y. 
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cumbersome  nature  of  even  this  simple  problem  is  apparent  when  we 
realize  that  there  are  20  different  ways  in  which  we  can  combine  the 
six  components  of  y  into  groups  of  three :  in  other  words,  there  are  20 
different  sets  of  three  equations  in  three  unknowns  to  be  solved. 

All  but  two  of  these  sets  result  in  inconsistency,  negative  coordi- 
nates, or  more  than  three  zero  (and,  therefore,  less  than  three  posi- 
tive) components  of  y.  The  two  exceptions  are  those  which  involve : 

(1)  setting  y2,  y4,  and  y6  equal  to  zero,  thus  solving  for  yh  y3,  and  y6; 

(2)  setting  y1}  yi}  and  y6  equal  to  zero,  thus  solving  for  y2,  yif  and  y6. 
In  other  words,  four  of  our  six  points  are  involved,  and  we  join  these 
four  points  (except  for  Px  and  P2)  in  Diagram  5. 

This  picture  is  strikingly  similar  to  that  of  Diagram  4.  Again  we 
are  looking  into  the  jaws  of  a  (somewhat  less  aesthetically  appealing) 
trap,  with  the  hinge  in  back  represented  by  the  broken  line  joining 
P3  and  P5.  The  ray  through  P0  (the  vertical  axis,  in  this  case)  appears 
through  the  top  of  the  bottom  jaw  at 

1 

amP0  = P0  =  (0,  0,  1/4) 

4,000 

and  disappears  (briefly)  through  the  bottom  of  the  top  jaw  at 

^°~'»  =(°.0,l/2). 

A  little  reflection  reveals  clearly  that  this  visualization  process  is 
good  only  for  what  we  have  intended  it :  namely,  to  grasp  more  easily 
the  fundamental  nature  of  linear  programming  problems  and  their 
solutions.  The  visualization  is  certainly  not  a  substitute  for  solving, 
or  even  for  finding  the  best  point  of  initial  attack  on,  a  linear  program- 
ming problem.  We  can  depict  most  of  the  more  salient  points  in  the 
blending  problem  in  a  perspective  fairly  easy  to  grasp.  But  we  can 
do  this  only  because  we  started  with  a  knowledge  of  all  the  answers. 
One  can  readily  imagine  the  intricate  picture  we  should  have  on  our 
hands,  if  we  made  all  possible  straight-line  connections  between  the 
six  points  in  order  to  show  all  of  the  20  possible  triangles! 

On  the  other  hand,  armed  with  all  20  answers  in  advance,  one  can 
visualize  that: 

(1)  the  P0  ray  does  not  touch  any  part  of  7  of  the  20  possible  tri- 
angles— PiP2P3,  P1P2P4,  P1P2P5,  P1P3P4,  P1P4P5,  P2P3P4,  and 
P2P4P5 ; 
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(2)  the  P0  ray  touches  10  of  the  20  possible  triangles  only  at  the 
P6  vertex— PiP,P6,  PiP3P6,  PiP4P6,  PiP5P6;  P2P3P6)  P2P4P6, 
P2P6P6;  P3P4P6,  PzP*P*\  and  P4P5P6; 

(3)  the  P0  ray  goes  "through"  one  of  the  triangles  only  at  the  co- 
ordinates point  of  (0,  0,  0)-P3P4P5. 

This  leaves  only  two  other  triangles,  which  are  the  two  depicted  in 
Diagram  5. 
The  triangle  formed  by  Pi,  P3,  P5,  in  which 

1 

amP0  =  P0 

4,000 

lies,  represents  positive  y  components  of  (yly  y3,  y5)  =  (1,000,  1,000, 
2,000)  .6  The  triangle  formed  by  P2,  P3,  P5,  in  which 

1 

olmPq  = Po 

2,000 

lies,  represents  positive  y  components  of  (y2,  y3,  yd  =  (1,000,  500,  500), 
and  we  read  in  Chapter  I  that  this  latter  solution  is  the  maximizing  one. 
Since  aM  represents  the  solution  which  minimizes  (yx+  •  •  •  +yn+m), 
if  it  is  true  that  the  (y2,  y3,  y5)  solution  is  the  maximizing  one,  it  must 
follow  that  the  solution  which  maximizes  (vi-f-  •  •  •  -\~yn+m) — namely, 
the  solution  represented  by  am — is  not  necessarily  the  solution  which 
maximizes  the  functional.7 

This  means  that  what  we  get  from  am  and  aM  is  primarily  an  in- 
sight into  the  whole  range  oi  feasible  solutions  to  the  linear  program- 
ming problem,  rather  than  a  certain  indication  of  the  solution  which 
will  maximize  the  functional.  We  can  rightly  infer  from  Diagram  5 
that  there  is  a  solution  involving  positive  values  for  (y2,  y3,  y5),  a  solu- 
tion involving  positive  values  for  (yh  y3,  y5),  and  an  infinite  number  of 
solutions  involving  positive  values  for  (yh  y2,  y3,  y5)  represented  by 
the  line  segment  between  aMPo  and  amP0-  We  cannot,  however,  know 

6  This  means  blending  all  1,000  of  the  pitch  with  1,000  flux;  and  y5  =  2,000  would  mean 
giving  away  4  points  of  gravity  (i.e.,  making  the  fuel  oil  gravity  16,  instead  of  the  mini- 
mum 12). 

7  Perhaps  it  should  be  noted  that  we  could  also  form  a  tetrahedron  by  joining  P3,  P4, 
P5,  and  P6.  Hereajif  is  at  P6  and  equals  1/1,000  (y6=  1,000,  and  all  other  components  equal 
zero).  Since  y6=the  pitch  we  do  not  run,  this  says  we  could  minimize  "profits"  (this  is,  of 
course,  not  the  economist's  concept  of  profits,  since  fixed  costs  continue  even  at  a  zero  rate 
of  operation)  at  zero  by  doing  nothing.  And  am  is  at  the  coordinates  point  (0,  0,  0),  with  a 
value  of  1/0,  which  is  meaningless,  as  is  also  the  implicit  "solution"  involving  flux,  vis- 
cosity giveaway,  and  gravity  giveaway. 
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the  solution  which  maximizes  the  functional,  without  considering  the 
functional  itself. 

Determination  of  the  solution  optimizing  the  functional  is  the  next 
step  towards  an  understanding  of  the  rationale  underlying  the  solu- 
tion of  linear  programming  problems.  The  answer  to  this  question 
could,  of  course,  be  illustrated  with  reference  to  this  same  blending 
problem.  But  a  properly  chosen  hypothetical  case  is  better  calculated 
to  offer  the  maximum  understanding  with  a  minimum  of  unnecessary 
complications. 


CHAPTER  III 
The  Simplex  Method 

Perhaps  the  best-known  method  of  solving  a  linear  programming 
problem  is  the  simplex  method.  This  method,  due  to  G.  B.  Dantzig,1 
at  each  stage  indicates  (among  other  things)  whether  the  solution  is 
optimal,  and  where  the  solution  can  be  bettered  if  it  is  not  optimal. 
That  is,  it  does  these  things  unless  we  first  run  into  a  solution  involv- 
ing fewer  positive  components  of  y  than  we  have  equations — and 
A.  Charnes  has  devised  a  method  for  coping  with  this  contingency.2 

While  the  simplex  method  can  be  reduced  to  a  set  of  routine  steps 
requiring  nothing  more  than  arithmetic,  our  principal  interest  lies  in 
the  rationale  behind  this  routine.  This  rationale  is  difficult  to  follow, 
unless  we  first  learn  a  little  about  three  matrix  algebra  concepts. 
Armed  with  these,  we  can  then  work  through  the  algebraic  rationale 
of  a  simple  example,  generalize  this  algebraic  rationale,  and  end  by 
displaying  all  this  in  tabular  form  in  the  so-called  simplex  tableau. 

MATRIX  ALGEBRA 

Even  at  an  elementary  level,  the  general  rules  of  matrix  algebra  are 
numerous  and  somewhat  complicated.  To  acquire  the  insight  we  need, 
however,  it  is  enough  to  understand  but  three  of  these  and  to  be  able 
to  apply  them  to  a  small  matrix.  These  three  concepts  are  determi- 
nants, matrix  multiplication,  and  the  inverse  matrix. 

We  can  acquire  some  understanding  of  these  concepts  through  the 
following  simple  problem,  which  we  have  previously  met: 

4yi  +  y2  =  5  anyi  +  a12y2  =  fa 

or,  more  generally, 
2yi  +  3y2  =  6  a2iyi  +  022^2  =  fa 

If  we  multiplied  the  first  equation  by  3  (the  a22  coefficient)  and  the 
second  equation  by  1  (the  a12  coefficient),  y2  would  cancel  out,  if  we 
then  subtracted  the  second  equation  from  the  first  equation,  after 
which  we  could  solve  for  y±.  In  other  words: 

3  •  5  —  1  •  6  022#i  —  dnfa 

71  =  TI — T^  =  9/10;    or-    yi  = 

O    4  —   I-  A  d22d\\  —   012#21 

1  T.  C.  Koopmans  (ed.),  Activity  Analysis  of  Production  and  Allocation  (New  York:  John 
Wiley  and  Sons,  Inc.,  1951),  Chapter  XXI. 

2  A.  Charnes,  "Optimality  and  Degeneracy  in  Linear  Programming"  Econotnetrica, 
1952,  pp.  160-172. 
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Similarly,  it  can  be  seen  that 


J2  = 


4-6  -  2-5 

4-3  -  2-1 


=  7/5; 


or, 


yi 


#11#2  —   #21&1 


#11022   —   #21  #12 


We  can  express  both  the  numerator  and  the  denominator  for  both  y\ 
and  y2  in  terms  of  2X2  determinants,  a  determinant  being  a  function 
of  a  square  matrix  (or  array  of  numbers)  which  can  be  "evaluated" 
into  a  single  number  in  solving  simultaneous  equations: 


^i 


fa  #12 

02  #22 

#11  #12 

#21  #22 


J2 


#11 

fa 

#21 

fa 

#11 

#12 

#21 

#22 

(#11#22  —  #12#2l)   7^  0 


We  can  learn  two  important  things  from  these  last  expressions  for 
yi  and  y2.  In  the  first  place,  we  can  immediately  infer  the  general  rule 
for  evaluating  (i.e.,  finding  the  value  of)  a  2X2  determinant.  We  have 
just  seen  above  that  the  denominator,  for  example,  of  yi  (or  of  y2)  is 
(#n#22— #i2#2i).  If  this  is  so,  then  by  definition,  the  value  of  a  2X2 
determinant  must  be  the  cross  product  of  its  principal  diagonal  (#n#22) 
minus  the  cross  product  of  its  other  diagonal  (#i2#2i).  A  more  com- 
plicated and  more  general  rule  also  exists  for  evaluating  determinants 
of  any  order,  but  this  is  unnecessary  for  us.  The  important  thing  is 
that,  from  this  example  of  evaluating  a  determinant  of  order  2,  we 
can  readily  grasp  the  logic  underlying  determinant-evaluation  rules. 

Secondly,  we  see  that  yx  and  y2  have  the  same  denominator,  and  this 
denominator  is  the  determinant  of  the  matrix  of  the  coefficients  of  yi  and 
y2.  This  means,  in  effect,  that  we  are  multiplying  the  determinant  of 
the  matrix  numerators  of  both  yx  and  y2  by  the  reciprocal  of  the  deter- 
minant of  the  matrix  of  coefficients  for  y\  and  y2.  This  is  the  heart  of  a 
concept  for  which  we  shall  have  real  use:  the  inverse  matrix.3  But, 
before  we  can  consider  this,  we  must  learn  one  other  rule :  the  rule  for 
matrix  multiplication. 

The  rationale  for  the  rule  of  matrix  multiplication  is  rooted  in  the 
same  general  setting  of  elementary  algebra  as  is  the  rule  for  determi- 
nant evaluation.  This  being  so,  perhaps  we  can  accept  the  rule  for 


3  In  matrix  algebra,  there  is  no  such  operation  as  dividing  one  matrix  by  another  matrix; 
but  multiplication  by  the  inverse  of  the  denominator  matrix  accomplishes,  as  we  shall  see, 
the  equivalent  of  this  familiar  operation. 
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matrix  multiplication  on  faith,  since  a  demonstration  of  its  rationale 
would  be  more  extensive  than  seems  justifiable  for  our  purposes. 

To  state  the  rule  in  its  most  terse  (and  most  frightening)  form,  if  we 
pre-multiply  a  matrix  B  by  a  matrix  A,  the  product  of  AB  will  also 
be  a  matrix  C  each  of  whose  elements  dj  is  obtained  by  the  rule: 

n 


&=1 


This  compact  notation  has  much  to  recommend  it,  but  it  is  certain  to 
be  meaningless  to  a  non-mathematician,  until  he  has  digested  what  it 
means  in  words.  Let  us  consider,  then,  what  this  symbolic  rule  says 

in  words. 

Suppose  both  matrix  A  and  matrix  B  are  2X2  matrices,  and  we 
want  to  find  cn  (the  element  in  the  first  row  and  the  first  column  of 
matrix  C),  so  i=  1  and  j=  1.  Now  the  subscript  k  stands  for  the  &th 
column  in  A,  but  for  the  Mi  row  in  B.  Since  both  A  and  B  are  2X2 
matrices,  k  stands  for  both  1  and  2  (but  not,  of  course,  simultane- 
ously). Therefore,  Cn=an&ii+0i2&2i;  and,  if  the  ci3-  we  want  is  c12} 
then  c12=an&i2+ai2&22.  In  yet  different  words,  to  get  the  element  in 
the  first  row  and  the  first  column  (tii)  of  C,  we  multiply  each  element 
in  the  first  row  of  A  into  its  corresponding  (first  or  second)  element  in 
the  first  column  of  B,  and  add  the  two.  And  to  get  the  element  in  the 
first  row  and  the  second  column  (ci2)  of  C,  we  multiply  each  element 
in  the  first  row  of  A  into  its  corresponding  element  in  the  second 
column  of  B,  and  add  the  two.  Thus,  we  can  say  that  the  matrix 
multiplication  rule  is  one  of  multiplying  row  into  column.4 

To  illustrate  this,  consider  a  concrete  example  of  multiplying  two 
matrices  for  which  we  shall  have  a  future  use: 
T4     in      j-3/10        -1/10-1 
[_2     3  J  X  L  -  1/5  2/5  J 

r  (12/10 -1/5)    (-4/10  +2/5)1      ri     0  1 
"  L  (6/10  -  3/5)     (-  2/10  +  6/5)  J       L  0     1  J 
The  product  of  our  two  matrices  thus  results  in  the  matrix  on  the  far 
right— a  matrix  with  ones  in  the  principal  diagonal  and  zeros  every- 

4  A  little  reflection  makes  it  clear  that  this  is  a  law  which  has  no  exact  counterpart  in 
elementary  algebra.  The  familiar  commutative  law  of  multiplication  postulates  that 
ab  =  ba.  But,  in  matrix  algebra,  AB^BA,  i.e.,  which  matrix  is  the  multiplier  and  which  the 
multiplicand  does  affect  the  product  matrix,  C.  Nor  can  we  multiply  two  matrices,  unless 
the  multiplier  has  the  same  number  of  columns  as  the  multiplicand  has  rows. 
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where  else.  This  matrix  I  is  the  unit  matrix  (sometimes  called  the 
identity  matrix) .  Furthermore,  the  second  matrix  from  the  left  is  the 
inverse  matrix  of  the  far  left  matrix;  and,  in  the  above  illustration  of 
matrix  multiplication,  we  also  have  an  illustration  of  the  nature  of  an 
inverse  matrix. 

The  inverse  matrix  obviously  has  a  counterpart  in  elementary  al- 
gebra, which  latter  says  that  the  inverse  of  a  number,  a,  is  a~1=  1/a, 
so  that  a-'cr1  =  l.  Similarly,  the  inverse  of  matrix  A  is  A-1  =  I/A,  so 
that  A'A~1  =  I,  I  being  the  identity  (or  unit)  matrix.5 

Now,  from  our  earlier  expressions  of  yx  and  y2  in  the  form  of  a  2X2 
determinant  divided  by  a  2X2  determinant,  along  with  the  definition 
of  A'1 7  it  follows  that 

Ly2j        ran    ai2  ~|        Lb2J       L  gn     £22  J       L  b2  J  L  h  J 

L  021      022  J 

and  we  can  check  this  for  the  initial  system  of  two  equations  in  this 
chapter,  since  the  above  inverse  matrix  of  specific  numbers  is,  in  fact, 
the  inverse  matrix  of  the  matrix  of  coefficients  for  yx  and  y2  in  that 
system: 

pi       T3/10        -1/101      [51 

LyJ       L-l/5  2/5  J       |_6  J 

r  (15/10      -  6/10) -I  =  r  9/ion 

L(-l         +12/5)  J       L  7/5  J 

We  now  have  a  little  knowledge  of  determinant  evaluation,  and, 
more  importantly,  of  matrix  multiplication  and  the  inverse  matrix. 
We  may  be  a  far  cry  from  polished  mathematicians,  but  we  should  be 
well  enough  equipped  to  understand  the  rationale  for  the  simplex 
method  of  getting  to  the  solution  of  a  linear  programming  problem 
in  an  efficient  manner. 

6  In  case  it  is  not  yet  obvious  how  one  gets  each  of  the  unknown  elements  (call  them  gif) 
of  an  inverse  matrix,  in  our  illustration  above  we  have: 

L2    3  JX  lg2l    g22J  =  Lo    1  J 

Using  the  matrix  multiplication  rule,  we  find,  for  example,  that: 

4gu  +  g21  =  1 

2gu  +  3g2i  =  0 

Solving  these,  we  get  gu  =  3/10;  g2i=  — 1/5,  and  gn  and  g22  can  be  determined  in  a  similar 
manner. 
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SIMPLEX  RATIONALE 

If  we  add  two  more  unknowns  to  the  two  equations  set  forth  in  the 
first  section  of  this  chapter,  we  shall  have  one  of  the  simplest  possible 
cases  for  illustrating  the  rationale  of  the  simplex  method.  So  let  our 
problem  be: 

(1)  Given  the  requirements 

4yi  +    3>2  +  3y3  +  0y4  =  5 
2yi  +  3y2  +  0y3  +  4y4  =  6 

(2)  Maximize  the  functional 

}{y)  =  2yi  +  y*  +  2y*  +  yi 

This  problem  is  so  simple  that  it  can  be  quickly  solved  by  the  most 
naive  of  methods,  but  we  want  to  solve  it  the  hard  way  to  acquire  an 
understanding  of  the  simplex  method.  For  this  latter  method  would, 
of  course,  be  the  easy  way,  if  we  were  dealing  with  a  problem  of  large 
dimensions. 

Suppose  we  decide  to  make  our  first  solution  attempt  that  of  solv- 
ing for  yx  and  y2,  thus  setting  y3  and  y4  equal  to  zero.  In  linear  pro- 
gramming terminology,  y±  and  y2  would  be  the  basic  variables  in  this 
first  stage,  while  y3  and  y4  would  be  the  non-basic  variables.  In  general, 
however,  we  always  have  in  our  attempted  solutions  m  (i.e.,  the  same 
number  as  the  number  of  equations)  basic  variables  and  (n—m)  non- 
basic  variables.6  Having  reached  this  decision,  we  can  express  our 

equations  as 

4yi  +    y2  =  5  -  (3y3  +  0y4) 

2yi  +  3y2  =  6  -  (0y3  +  4y4), 
and  the  solution  for  y±  and  y2  would  be  given  by 

L  y2  J    "  L  h  J  I  L  023  J  L  <*24  J        ; 

_T3/10       —  1/10-1       [-5-1       T3/10       -1/10-1 
~  L  -  1/5  2/5  J  X  L  6  J       L  -  1/5  2/5  J 

6  The  symbol  n  is  now  being  used,  and  will  henceforth  generally  be  used,  in  a  different 
sense  from  that  in  Chapter  II.  In  Chapter  II,  n  represented  the  total  number  of  variables 
in  the  inequalities,  while  (»+*»)  represented  the  total  number  of  variables,  after  these 
inequalities  were  turned  into  equations  by  adding  another  variable  to  each  inequality. 
Henceforth,  unless  it  is  evident  that  we  are  doing  otherwise,  the  symbol  n  should  be 
understood  to  represent  the  total  number  of  variables,  after  the  linear  programmmg  prob- 
lem requirements  have  been  stated  in  equation  form. 
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Since  y3  —  y4  =  0,  the  last  two  terms  on  the  right  disappear,  and  the 
first  term  on  the  right  gives  us  what  we  have  previously  seen  to  be  the 
correct  answers  for  yi  and  y2. 

Nevertheless,  we  have  real  interest  in  the  last  two  terms  on  the 
right.  To  see  why,  let  us  begin  by  generalizing  the  above  solution 
for  yi  and  y2  into  an  equation  of  fundamental  importance : 


a) 
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where 


gll     •    '    '    glm 


gml   '    '    '  gmm  — 


is,  of  course,  the  inverse  matrix  (having  mXw  elements)  of  the  ma- 
trix of  coefficients  for  the  m  basic  variables.  In  effect,  this  says  that 
what  we  know  is  true  for  a  problem  in  two  requirements  equations 
and  four  variables  is  equally  true  for  a  problem  in  m  requirements 
equations  and  n  variables. 

In  equation  (1),  as  well  as  in  the  specific  counterpart  of  it  for  our 
little  problem,  we  have  particular  interest  in  two  types  of  terms: 
(a)  The  m  (2,  in  our  problem)  terms  we  get  from  pre-multiplying  the 
column  vector  b^(bi,  •  •  •  ,  bm)  by  each  of  the  m  rows  of  the  in- 
verse matrix.  These,  of  course,  give  us  the  values  of  the  m  com- 
ponents of  y.  For  example, 

kii   gn]  x  [  J  =  [Vio    -  i/io]  X  [J 

=  (15/10  -  6/10)  =  9/10  =  yi. 
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To  get  such  expressions  down  to  manageable  size,  let  us  define 

h 

[gul  '    '    '  gum]   X 


ZU0 


Thus,  010  would  mean  that  u=  1,  and  is  the  number  we  would 
get  by  taking  the  first  row  of  the  inverse  matrix,  pre-multiply- 
ing  each  of  the  m  elements  in  that  row  into  its  corresponding 
element  in  the  column  vector  of  b,  and  summing.  This  also 
means  that  zuo/=yu;  hence,  in  our  example,  0iO  =  yi  =  9/lO.  And 

020  =  ^2=7/5. 

(b)  The  m(n—m)  terms  [2(4— 2)  =  4,  in  our  problem]  we  get  from 
pre-multiplying  each  of  the  (n—m)  column  vectors  of  coefficients 
associated  with  the  non-basic  variables  (ym+i,  •  •  •  ,  yn)  by  each 
of  the  m  rows  of  the  inverse  matrix.  Thus, 

kn  gn]  X  [**.]  =   [3/10  -  1/10] -X  [°]  =  (0  -  4/10)  =  -  4/10, 

in  our  example.  To  deal  with  these  m(n—m)  terms  more  com- 
pactly, let  us  define 

a\,m4k 

X 


Zu,m-\-h  {.gul 

W=l 


'gx 


amtm+k  - 

where  k=  1  to  (n—m).  In  our  example,  this  merely  means  that: 

Zl,m+1   =   013   =    9/10  01„  =  014  =    -  4/10 

0m,m+l   =   023   =    ~   3/5  Zmn  =  024  =   8/5 

With  these  definitions,  we  have,  in  effect,  labeled  each  of  the  num- 
bers gotten  on  the  right  side  of  equation  (1)  from  pre-multiplying  a 
column  vector  (whether  it  be  the  b  vector  or  a  vector  associated  with 
one  of  the  non-basic  variables)  by  a  row  vector  (whether  it  be  the 
1st,  or  any  other,  row  up  to,  and  including,  the  mth)  of  the  inverse 
matrix.  And  the  subscripts  tell  us  readily  which  row  of  the  inverse 
matrix  and  which  column  vector  entered  into  each  of  these  figures. 
Thus,  0mO  is  the  figure  resulting  from  pre-multiplying  the  0th  column 
vector  (which  is  the  b  column)  by  the  mth  row  of  the  inverse  matrix; 
and  0mO  must  be  the  same  thing,  then,  as  ym.  And  zmn  is  the  result  of 
pre-multiplying  the  column  vector  of  coefficients  associated  with  yn 
by  the  mth  row  of  the  inverse  matrix. 
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Here,  again,  complete  absorption  of  the  meaning  of  the  notation  is 
important  to  a  ready  understanding  of  the  nature  of  all  these  z's;  but, 
once  the  meaning  of  the  notation  is  firmly  embedded,  the  rest  is 
reasonably  smooth  sailing.  By  virtue  of  the  definition  of  the  z's,  we 
can  state  equation  (1)  in  an  alternative  (and  more  compact)  form 

m  n—m 

(la)  yu  =  %uo  —  2-f  Zu.m+kym+k- 

u=\  k=l 

This  means,  for  example,  that  in  our  problem  we  could  say 

y\  =  zio  —  (znyz  +  Zi^O 

y%  =  220  -  (223^3  +  224^4) 

Since  y3  and  y4  equal  zero,  this  may  seem  like  a  nonsensical  procedure 
— and  it  would  be,  if  we  were  merely  trying  to  find  the  values  of  yi 
and  y2.  But  the  purpose  of  this  is  more  subtle  and  more  important 
than  that  of  merely  finding  the  values  of  yx  and  y2.  We  are  now  in  a 
position  to  ascertain  whether  the  y=(yi,  yz)  solution  is  optimal. 
Our  functional  to  be  maximized  is 

f(y)  =  2yi  +  ly%  +  2yz  +  ly4 

If  we  substitute  z10—  (213^3+214^4)  and  220— (223^3+224^4)  for  yx  and  y2, 
respectively,  into  our  functional,  we  get 

(f)y  =  (2210  +  I220)  +  {  [2  -  (2zi3  +  lzu)]yt  +  [l  -  (2«M  +  lftO]^} 
=  16/5  +  4/5^  +  l/5y4 
This  specific  result  of  substituting  into  the  functional  can  be  general- 
ized into  a  second  equation  of  fundamental  importance.  It  will  pay 
us  to  see  how. 

A  general  statement  of  our  functional  we  know  to  be : 

Maximize /(y)  =  ciyi  +  •  •  •  +  cnyn 

Now  consider  the  specific  statement  of  the  last  paragraph.  The  first 
term  in  parentheses  is  actually 

(m=2  \ 

What  is  the  general  nature  of  each  of  the  bracketed  terms  preceding 
yz  and  y4?  If  we  carefully  traced  each  step  of  the  substitution  into  the 
functional,  we  should  discover  that  these  bracketed  expressions 
amount  to: 
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[C3  —    (CiZl3  +  C2Z2z)]yz  +    [Ci  —    (CiZu  +  C2Z2i)]yi 
n—m    /  m  \ 

=      JLf    I  C™+&  —     -2-f  cw2m,wH-A;  )  )W& 

We  can  generalize  the  functional,  then,  as: 

m  n—m    /  m  \ 

(2)  f(y)    =    ]C  CuZuO  +    S   (Cm+&   —    2-/  CuZu,nrt-k)ym+k 

Usually,  (2)  is  expressed  even  more  succinctly  by  denning 

m  m 

Zoo  =  2^/  cuZuo  and  Zo,m+k  =  cm+k  ~~  Z_^  cuzu,m+k- 

u=l  u=l 

Then  (2)  becomes: 

n—m 

(2a)  f(y)  =  Zoo  +  X)  Zo,m+kym+k 

An  understanding  of  both  the  (2)  and  the  (2a)  forms  is  desirable  for 
an  understanding  of  the  symbolic  terminology  customary  in  a  sim- 
plex tableau. 

Having  extended  the  substitution  of 

m=2 
Ju 

into  our  specific  functional  into  the  generalized  equations  of  (2)  and 
(2a),  let  us  return  once  more  to  our  specific  substitution,  in  order  to 
see  its  relationship  to  the  problem  of  determining  whether  our 
J—  Cyi>  ^2)  solution  is  optimal.  The  first  expression  in  ordinary  paren- 
theses tells  us  what/(y)  will  be,  when  y3  =  y4  =  0.  This  yields  a  result 
of  zoo=  (2 -9/10+1  •  7/5)  =  16/5.  The  pertinent  question  is  whether 
we  can  increase  z0o  by  removing  either  yx  or  y2  from  our  basis  (by 
setting  one  of  them  equal  to  zero)  and  bringing  either  y3  or  v4  into  the 
basis  to  supplant  the  variable  thus  removed. 

Both  yz  and  y4  are  multiplied  by  expressions  enclosed  in  brackets 
[  ],  and,  if  the  expression  associated  with  (say)  y3  sums  to  a  negative 
figure,  we  will  only  hurt  our  cause  by  increasing  y3  from  zero  to  some 
positive  figure ;  but,  if  the  sum  is  positive,  we  can  improve  the  func- 
tional by  substituting  y3  for  either  yi  or  y2.  Why  this  is  so  will  become 
clear  in  a  moment,  when  we  consider  the  rule  for  removing  a  variable 
from  the  basis. 

As  it  happens,  both  y3  and  y±  are  preceded  by  bracketed  sums  that 
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are  positive.  There  is  no  infallible  rule  for  telling  us  which  of  these 
should  now  be  introduced  as  a  basic  variable.  Since  y3  is  preceded  by 
the  bigger  coefficient  (4/5)  of  the  two,  however,  we  might  choose  to 
introduce  y$. 

There  is  a  rule  for  telling  us  which  variable  to  remove  from  the  basis, 
however,  once  we  have  decided  on  the  variable  to  be  introduced.  We  can 
readily  see  from  equation  (la)  that,  if  we  increase  y3  from  zero  to  some 
positive  figure,  yz',  the  effect  upon  (say)  yx  will  be 

y\   =  zio  —  Znyz 

In  other  words,  since  we  know  that  yi  =  z10,  an  increase  in  y3  will  de- 
crease y\  by  Sis^s',  if  Z13  is  positive  (and,  of  course,  yi  will  be  increased 
by  ZiZys,  if  213  is  negative).  Since  we  must  not  allow  y±  to  fall  below 
zero,  we  cannot  safely  permit  y3'  to  be  larger  than  £io/W  For  this 
reason,  we  remove  from  the  basis  that  particular  component  of 

m 

yu 

for  which  the  positive  ratio  zuo/zu,m+h  is  smallest  [the  (ni+h)  portion 
of  the  subscript  being  identified  with  the  particular  component  of  y 
we  have  decided  to  bring  into  the  basis  (y3,  in  our  case)]. 

In  our  example,  the  smallest  positive  zu0/zU3  ratio  is,  in  fact,  that  of 
Z10/213.  We  know,  therefore,  having  previously  decided  to  bring  y3 
into  the  basis,  that  yx  is  the  variable  to  remove.  As  removing  yx  from 
the  basis  means  making  yi'  =  0,  it  follows  that 

Z10  —  z\3y%  =  0, 

so  yz'  =  z10/zu=l.  And  y2'  =  z^—z2zyz  =  7/5+3/5  =  2. 

This  clearly  represents  an  improvement  in  our  functional 

f(y)  =  2yi  +  ly2  +  2;y3  +  ly4 
At  the  end  of  the  first  stage,  we  had 

f(y)  =  2  X  9/10  +  1X7/5  +  2X0  +  1X0=  16/5, 
and  we  now  have,  at  the  end  of  the  second  stage, 

f(y)  =  2X0  +  1X2  +  2X1  +  1X0  =  4. 

Does  this  maximize  our  functional? 

If  we  went  through  the  process  we  did  above  of  substituting  in  the 
functional  for  the  basic  variables  (now  y2  and  ;y3)  expressions  in  terms 
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of  the  js's,  yiy  and  yi}  our  functional  would  become : 

f(y)  =  (lao  +  2z30)  +  { [2  -  (l*2i  +  2«n)]yi  +  [1  -  (1*4  +  2zu)]yi) 

We  know  the  values  of  z2o  and  230  (since  they  are  also  the  y2'  and  yzf 
we  just  computed  above),  but  we  do  not  know  the  values  of  the 
other  s's. 

We  can,  of  course,  get  the  values  of  these  other  z's  by  computing 
the  inverse  matrix  of  the  matrix  of  coefficients  of  the  new  basic  varia- 
bles (y2  and  y3),  and  pre-multiplying  the  appropriate  row  vectors  of 
the  inverse  matrix  into  the  appropriate  column  vectors  of  the  new 
non-basic  variables  (yi  and  y4).  We  needed  this  process  to  get  under 
way  on  the  first  stage,  and  this  is  the  rationale  underlying  the  z's  at 
any  stage.  But,  just  as  we  found  a  handy  way  of  calculating  y2'  and 
y3',  once  the  first  stage  was  completed,  there  are  equally  handy 
algorithms  for  computing  the  missing  z's,  and  these  algorithms,  along 
with  their  derivations,  are  given  in  the  appendix  at  the  end  of  this 
chapter.  In  trying  to  answer  the  question  of  whether  we  have  now 
maximized  our  functional,  however,  it  is  logical  to  introduce  the  no- 
tion of  the  simplex  tableau.  For  it  is  clear  that,  in  solving  a  linear  pro- 
gramming problem,  we  are  involved  in  an  iterative  process:  going 
from  solution  to  better  solution  to  (eventually)  an  optimal  solution. 

Even  with  algorithms  to  speed  the  transitions,  to  shunt  us  away 
from  blind  alleys,  to  help  point  the  way  towards  the  more  promising 
avenues,  and  to  announce  to  us  when  we  have  arrived,  the  optimal 
solution  will  rarely  come  to  us  as  a  blinding  revelation.  It  is,  therefore, 
important  to  have  an  orderly  tabulation  of  successive  solutions.  This 
makes  it  possible  to  see  clearly  where  we  have  been,  whether  we  have 
any  place  left  to  go,  and,  if  so,  the  alternative  routes  remaining  open 
to  us. 

THE  SIMPLEX  TABLEAU 

Table  I  is  a  so-called  extended  simplex  tableau,  and  it  is  divided  into 
three  parts,  each  of  which  includes  the  pertinent  information  for  one 
of  the  three  solutions  involved  in  reaching  the  optimal  solution  to  our 
simple  problem.  Thus,  the  top  third  is  concerned  with  the  first  stage 
of  the  simple  problem  we  considered  in  detail. 

The  first  and  second  columns  list  the  coefficients 

( i.e.,  the  cu  from  the  functional  equation  J 
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of  the  basic  variables  and  the  "names"  of  the  basic  variables  in  that 
stage,  respectively.  The  third  column  contains  the 


ZuO, 


which  we  know  is  the  same  thing  as  the  values  of  the 


i.e.,  the  values,  in  that  stage,  of  the  basic  variables.  The  figure  at  the 
bottom  of  this  column  shows  the  value  of  the  functional,  z0o,  and  is, 
of  course,  the  figure  obtained  by  multiplying  each  zu0  by  its  associated 
cu  and  summing  them  algebraically,  i.e., 


Zoo  —    2-^  CuZuO- 


At  the  top  of  the  next  four  columns  appear  the  "names"  of  all 
variables,  the  first  two  of  these  representing  the  basic  variables,  and 
the  last  two  the  non-basic 


/n—m      \ 


variables.  Underneath  each  of  these  four  "names"  is  listed  the  associ- 
ated coefficient  (cn)  from  the  functional.  The  variables  bear  not  only 
their  specific  names  (e.g.,  yj  but  their  general  names7  as  well  (e.g., 


yu 


7  The  general  "names"  are  dropped  after  the  first  stage,  with  only  specific  subscripts 
being  used.  This  is  done,  partially,  because  it  should  be  enough,  for  illustrative  purposes, 
to  show  the  general  names  but  once.  The  general  "names"  of  the  first  stage  apply,  however, 
in  succeeding  stages,  only  if  we  re-name  our  variables.  For  example,  when  we  introduce  yz 
into  the  basis,  we  can  no  longer  say  that  the  basic  variables  are 


yu, 


because  the  subscript  of  yz  is  really  (m+1)  =  (2+1).  So  we  would  have  either  to  say  that 
the  basic  variables  in  the  second  stage  are 


«»+i 

yu 


or  to  re-name  our  variables. 
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for  the  basic  variables,  and 

n—m 

Jm+k 
k=l 

for  the  non-basic  variables) .  And,  in  two  cases,  they  bear  two  general 
names  (yu  —  yr)  for  the  basic  variable  to  be  removed  from  the  basis  in 
the  second  stage,  and  (ym+i  =  ym+h)  for  the  non-basic  variable  to  be 
introduced  into  the  basis  in  the  second  stage. 

The  z's  in  the  non-basic- variables  columns  are  old  friends,  and  we 
need  only  make  one  comment  about  them.  One  of  them  is  asterisked 
in  each  stage  (213,  for  example,  in  the  first  stage).  This  is  the  so-called 
pivot — the  point  of  juncture  of  the  variable  to  be  introduced  into,  and 
the  variable  to  be  removed  from,  the  basis.  Thus,  Zu  has  a  subscript 
telling  us  that  yi  is  to  be  removed  and  y3  is  to  be  introduced  in  the 
second  stage. 

The  figure  at  the  bottom  of  each  non-basic-variable  column  is  ob- 
tained by  multiplying  each  z  in  that  column  by  the  basic  variable 
coefficient  (from  the  far  left  column)  in  the  same  row  (cv  zu  and  cr  Z23, 
for  example),  summing  these  cz's,  and  then  subtracting  that  sum  from 
the  functional-equation  coefficient  near  the  top  of  each  column.  Thus 
for  each  of  these  columns  we  get  at  the  bottom  a  figure 


=1  \  u=l  / 


As  we  already  know,  if  any  one  of  these  bottom  figures  is  positive, 
we  can  increase  Zoo  by  next  introducing  into  the  basis  the  variable 
whose  "name"  is  at  the  top  of  that  column.  Thus,  both  y3  and  y4  are 
possibilities  at  the  end  of  the  first  stage. 

In  the  second  stage  of  the  tableau,  we  move  y3  to  the  position  for- 
merly held  by  yi,  and  we  move  yx  to  the  position  formerly  held  by  y3. 
The  various  new  z's  are  easily  calculated  from  our  algorithms,  and 
we  see  from  z03  and  z0i  that  y4  is  the  only  non-basic  variable  that  can 
be  profitably  brought  into  the  basis,  while  y2  should  be  removed. 
Thus,  z24  is  the  new  pivot. 

Finally,  replacing  y2  with  y4  as  a  basic  variable  and  again  calculat- 
ing the  z's,  we  see  that  both  z0i  and  z02  are  negative.  This  tells  us  that 
we  have  reached  the  optimum  solution,  and  we  see  that  this  optimum 
entails  z0o  =  29/6. 
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THE  CASE  OF  A=A_1  =  7 

Solution  of  a  linear  programming  problem  can  be  simplified  even 
further,  if  the  constraints  are  such  that  the  inverse  matrix,  A~\  of 
the  initial  stage  can  be  made  equal  to  the  unit  matrix,  /.  The  problem 
we  have  treated  so  laboriously,  in  the  interests  of  understanding  the 
underlying  rationale,  can,  in  fact,  easily  be  turned  into  such  a  prob- 
lem. 

If  we  divide  our  first  constraint  through  by  3,  and  our  second  con- 
straint through  by  4,  we  get: 

(4/3)3*  +  (V3)*  +  ?3  +  0y4  =  5/3 
(1/2)3*  +  (3/4)3*  +  0y3  +  y*  =  3/2 

The  obvious  first  stage  to  this  problem  is  to  let  yi  =  y2  =  0.  The  matrix 
of  coefficients  for  our  basic  variables  (y3,  yO  is  now 

which  is,  itself,  a  unit  matrix.  The  inverse  of  a  unit  matrix  is,  how- 
ever, also  a  unit  matrix,  so  we  have: 

n    on     r>  =  i   gi4  =  (n  =  ri    o-i 

LO        lj  Us   =   0       g24   =    1J  L0        lj 

From  equation  (1)  we  can  immediately  say  that 

The  three  column  vectors  on  the  right  of  this  equation  thus  represent, 
not  only 

L  b2  J '     L(hi  J '  L022  J  ' 

they  also  represent 

r*i_p»i  n  and  r*! 

L  y4J      LZ40J      LZ41J  LZ42J 

In  other  words,  given  a  unit  matrix  of  coefficients  for  the  basic  varia- 
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bles,  the  first  stage  (except  for  the  bottom  row)  of  the  simplex  tableau 
can  be  written  down  directly  from  the  coefficients  of  the  constraints 
and  the  functional. 

Following  this  procedure,  we  could  have  immediately  written  down 
the  last  stage  of  Table  I  as  our  initial  stage,  and  have  seen  from  the 
signs  of  soi  and  z02  that  our  initial  stage  also  gave  us  the  optimum 
solution.  On  the  other  hand,  had  this  not  been  the  optimum  solution, 
we  could  readily  have  calculated  the  z's  for  successive  stages  from 
algorithms. 

APPENDIX  TO  CHAPTER  III 
Derivation  oe  Algorithms  for  Calculating  Successive  Z's 
From  equation  (la): 

n — m 
m  ^-v 

yu    ~    ZU0   ~    2^1  Zu,m+kym+k 

u=l  k=l 

If  yr  is  the  particular  yu  to  be  removed,  and  if  ym+h  is  the  particular 
ym+k  to  be  introduced,  at  the  next  stage, 

n—m 
yr  +  Z^  Zr,m+kym+k  =  Zr0 

Since  ym+h  is  a  particular  ym+k,  it  is  included  in  the  second  term  on  the 
left  of  this  last  equation,  and  we  can  divide  this  term  into  two  parts 
to  get: 

n—m 

yr  +  Zrtm+hym+h  +       Z-f    Zr,m+kym+k   =   Zr0 
k=l^h 

Dividing  this  last  equation  through  by  zr,m+h}  we  have: 

ZrO  r        1  ,        ™    Zr<m+k  1 

(3)        ym+h  = yr  +     2^  ym+k    ,  Zr,m+h  >  0 

Zr,m+h  \-Zr,m+h  k=l^h  Zr,m+h  J 

Similarly,  we  can  also  write  (la)  in  the  form: 

m  n—m 

yU  "f"  Zu,m+hym+h  +      2~t    Zu,m+kym+k   =   ZUQ 
u=l  k^l^h 

If  we  now  substitute  for  ym+h  in  this  last  equation,  the  lengthy  expres- 
sion on  the  right  of  equation  (3),  we  get: 
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Zu,m+h 

Ju    ~   ZuO zrO 

u=l?*h  Zr,m+h 

(4) 


^     ["  Zu,m+h  I  Su,»H-A 

•  ,         Zu,m+k Zr,m+k  \ym+k   H  Jr 

k=l*h  L  Zr,m+h  J  Zr,m+h 


Zm+h,0,  Zm+h,m+k,   dtld  Zm+h,r' 

Since  yr  and  all 


ym+k 

k=l*h 


are  zero,  equation  (3)  gives  us  algorithm : 

(a)  Vm+h  =   2TO+A,0   = 

Zr  ,m-\-h 

Equation  (3)  also  provides  us  with  two  other  algorithms,  for  (3)  is 
really  a  statement  of  (la)  with  particular  reference  to  ym+h.  Conse- 
quently, just  as  the  first  term  on  the  right  of  equation  (3)  is  zm+h,o, 
so  do  the  coefficients  in  (3)  of  yr  and  ym+k  represent  zm+h,r  and 
zm+h,m+k,  respectively.  Therefore  we  have  algorithms: 

1 

(b)  Zm+h,r  =  

Zr,m+h 

Zr,m+k 

(c)  Zm+h,m+k   =   >    k  5*  ft 

Zr,m+h 

Computing  the  s's  for  the  entire  ym+h  row  in  the  successive  stages 
of  the  tableau  is,  therefore,  reduced  to  a  simple  set  of  routine 
calculations. 

Zuo  ,  Zu,m+k ,  and  zw' 
Since  yr  and  all 

n—m 

ym+k 


are  zero,  equation  (4)  gives  us  an  algorithm  for  all  new 


Zu,m+h 

(a)  yu    =  Zuo    =  zuo Zr0 

Zr,m+h 
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Equation  (4)  also  provides  us  with  two  other  algorithms,  in  much 
the  same  way  as  did  (3).  For,  just  as  the  first  two  terms  on  the  right 
of  (4)  give  us  yu'  =  zuo'  for  all  the  new  basic  variables  (except 
ym+h),  so  are  the  lengthy  coefficients  of  ym+k  and  yr  the  zu,m+k  and 
Zun  respectively.  Therefore,  we  have  the  algorithms: 

/   _  Zu,m+h 

\P)  Zu,m+k     ==    Zu,m+k  Zr,m-\-k 

Zr,m+h 

,  „N  Zu  ,m+h 

(f)  zur= 

Zr  ,m+h 

Algorithms  (d),  (e),  and  (f)  thus  make  possible  a  routine  of  calcula- 
tion of  all  the  remaining  z's  of  the  tableau,  except  those  of  the 
bottom  row. 

2oo/,  Zo,m+k   and  z0r  : 

As  we  know,  our  functional  to  be  maximized  can  be  expressed  as 

n—m 
f(y)   =  200  +   Zj  Zotm+kym+k 

So 

n—m 

Zoo'   =   Zoo  +  Zo,m+hym+h  +     Z-f    Z0,m+kym+k 

k^l^h 

If  we  once  more  substitute  the  right  side  of  (3)  for  ym+h  in  this  last 
expression,  we  get: 

;  Zo,m+h  Zo,m+h 

zoo  —  zoo  H zro yr 

Zr,m+h  Zr,m+h 

^T  Z0,m+h  1 

~T     2Li       Zo,m+k Zr,m+k   \ym+k 

k=l^h  L  Zr,m+h  J 

From  this  we  can  readily  deduce  algorithms: 

Z0,m+h 

\g)  Zoo     =  Zoo  ~\ Zr0 

Zr  ,m+h 

/                  Z°'m+h 
(h)  Zor     = 

Zr  ,m+h 

,  Zo,m+K 

(l)  Zo,m+k     —  Zo,m+k Zr,m+k 

Zr,m+h 

The  importance  of  the  pivot  in  all  this  is  manifest :  it  appears  in  each 
of  the  nine  algorithms. 


CHAPTER  IV 


Degeneracy 

Up  to  this  point,  all  of  the  examples  chosen  to  illustrate  the  funda- 
mentals of  linear  programming  have  behaved  nicely.  Not  all  problems 
exhibit  such  exemplary  behavior,  and  this  chapter  and  the  next  are 
concerned  with  three  difficulties  sometimes  encountered.  This  chapter 
is  devoted  to  the  problem  of  degeneracy,  i.e.,  encountering  a  basic 
feasible  solution  (which  may,  or  may  not,  be  the  optimum  solution) 
involving  a  zero  value  for  one  (or  more)  of  the  basic  variables. 
Chapter  V  is  concerned  with  the  other  two  difficulties. 

Degeneracy  might  be  defined,  rather  loosely,  as  a  solution  in  which 
at  least  one  of  the  basic  variables  has  a  value  of  zero.  More  mathe- 
matically, degeneracy  is  sometimes  defined  as  a  case  in  which  some 
submatrix  of  order  m  from  the  matrix 

#11    •   *  •  d\n      fa 


.dml 


bm_ 


is  singular  (i.e.,  the  determinant  of  the  submatrix  is  zero). 

A  simple  example  may  help  to  make  this  definition  clear.  Consider 
the  following  set  of  requirements  equations: 

4^i  +  y2  +  2^3  +  3^4  =  10 
Syi  +  2y%  +  3yz  +  4y4  f  10 
2yi  +  3y2  +  2y3  +  3y*  =  10 

Let  us  now  extract  the  coefficients  of  the  first  two  columns  on  the 
left  side,  and  the  coefficients  on  the  right  side,  of  these  equations  to 
get  the  following  submatrix  of  order  three: 


4     1     10" 

"flu 

#12 

m 

3     2     10 

= 

021 

022 

h 

2     3     10_ 

-031 

#32 

hi 

The  rule  for  evaluating  the  determinant  of  a  matrix  of  order  three  is: 

011022&3— 011^2032+012&2031— 012021&3+&1021032— &102203L  The  Value  Of  OUr 

determinant  is,  then:  80-120+20-30+90-40  =  0.  Thus  the  above 
set  of  equations  does  have  a  submatrix  of  order  m,  the  determinant  of 
which  is  zero,  and  we  must  have  a  case  of  degeneracy. 

45 
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We  can  visualize  what  this  means  from  Diagram  6,  which  depicts 
this  three-dimensional  set  of  equations.  Once  more  we  find  ourselves 
looking  into  the  jaws  of  a  "trap."  In  fact,  it  is  the  same  trap  as  ap- 
peared in  Diagram  4;  but,  because  the  right  side  of  the  third  equation 
has  been  increased  to  10,  the  P0  ray  disappears  from  view  behind  the 
trap,  never  piercing  any  of  the  plane  surfaces  (within  the  boundaries 
defined  by  the  edges  of  the  tetrahedron)  in  its  journey  from  the  origin 
to  P0.  But  the  P0  ray  does  touch  the  tetrahedron  formed  by  P1P2P3P4 
—at  the  coordinates  point  of  (5/2,  5/2,  5/2),  which  point  lies  on  the 
edge  of  the  tetrahedron  represented  by  the  line  connecting  Pi  and  P2. 


m 
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»(IO,IO,IO) 


This  means  that,  in  this  particular  case,  there  is  one  (and  only  one) 
solution  to  our  set  of  equations  which  will  have  only  non-negative 
components  for  y  =  (yh  y2,  ys,  yd .  This  unique  solution  is  y  =  (2, 2, 0, 0) , 
and  it  is  a  solution  involving  positive  values  for  less  than  m  (since 
m  =  3)  variables. 

The  problem  just  considered  is  misleadingly  simple.  The  fact  that 
one  can  encounter  degeneracy  in  a  problem  in  which  not  only  the  best 
solution,  but  even  the  only  solution,  involves  less  than  m  positive- 
value  variables  suggests  that  degeneracy  may  be  less  opprobrious 
than  it  sounds.  While  this  is  true,  our  example  gives  degeneracy  a 
cleaner  bill  of  health  than  it  deserves. 


DEGENERACY 


47 


Suppose  we  add  a  fifth  variable  to  our  three  requirements  equations 
and  formulate  the  following  problem: 

4?i  +  yt  +  2ys  +  3y4  +  3y5  =  10 
Syi  +  2y2  +  Sy3  +  4y4  +  ys  =  10 
2yi  +  3y2  +  2y,  +  3y4  +  2^6  =  10 
Maximize  y\  +  y2  +  yz  +  ?4  +  ^5 

Since  this  is  exactly  the  same  problem  as  the  preceding  one,  except 
for  the  addition  of  a  fifth  variable,  we  know  that  the  P0  ray  will  still 


m 


DIAGRAM    7 


cut  the  PiP2  line  at  the  point  aP0=  1/4P0  =  (5/2,  5/2,  5/2).  The  addi- 
tion of  the  fifth* variable,  along  with  the  inclusion  of  this  variable  in  the 
functional  to  be  maximized,  has,  however,  greatly  altered  the  nature 
of  the  problem — as  can  be  seen  from  Diagram  7. 

In  Diagram  7,  the  points  P2,  Pa,  Pi,  and  P5  have  been  joined  (except 
for  the  P3P4  edge  of  the  tetrahedron)  to  form  a  new  trap.  Pi  has  been 
left  in  solitary  grandeur,  but  if  we  joined  Pi  and  P2,  it  would  cut  the 
P0  ray  about  midway  between  amPQ  and  aMPo.  In  other  words,  every 
basic  feasible  solution  involving  yx  and  y%  would  result  in  y\  =  yi  —  2 
and  a  zero  value  for  whatever  one  of  the  other  three  variables  was 
chosen  as  the  third  basic  variable  in  the  search  for  the  optimum  solu- 
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tion  (and,  of  course,  the  two  non-basic  variables  would  also  have 
zero  values). 

More  important,  for  our  purposes,  the  segment  of  this  imaginary 
line  joining  P1  and  P2  which  lies  between  P2  and  the  point  at  which 
the  PiP2  line  would  cut  the  P3P4P5  plane  lies  entirely  inside  the  two 
jaws  of  our  trap.  This  is,  of  course,  necessarily  so,  since  aP0=  1/4P0 
lies  between  amPo  and  aMP0.  The  yi==y2  =  2  solution  cannot,  therefore, 
be  the  solution  which  maximizes 

5 

Parenthetically,  however,  we  can  readily  see  here  why  the  nature  of 
the  functional  to  be  maximized  determines  whether  am  will,  in  fact, 


(yi,  y*> 


ys)  which 


have  in  its  denominator  those  values  for  y 
will  maximize  the  functional. 

If  our  problem  were  simply  to  maximize  yi+y2+ys}  <xm  [which  actu- 
ally has  as  its  denominator  y  =  (0,  10/13,  30/13,  0,  20/13)  ]  would  im- 
ply a  functional  value  of  40/13.  This  40/13  is  smaller  than  the  func- 
tional value  for  a  solution  in  which  y=(2,  2,  0,  0,  0),  for  this  latter 
solution  means  a  functional  value  of  2+2+0  =  4,  no  matter  which  of 
the  last  three  variables  is  taken  as  the  third  basic  variable. 

Now  we  know  from  Diagram  7  that,  with  a  functional  requiring 
maximization  of  yi+yz+y*+yi+ys,  the  optimum  solution  involves 
y2,  3>s,  and  y5  as  the  basic  variables,  and  we  know  that  this  problem 
carries  also  the  possibility  of  encountering  degeneracy.  Let  us,  there- 
fore, choose  an  initial  attack  on  this  problem  which  will  assure  us  of 
meeting  degeneracy  before  we  reach  the  optimum  solution.  In  this 
way,  we  can  understand  more  clearly  the  manner  in  which  degeneracy 
is  likely  to  constitute  a  difficulty,  why,  and  what  can  be  done  about  it. 

We  choose  as  our  initial  solution : 


c2  =  1 
c4  =  1 

Cf>=   1 


-  5/16  -  3/16    9/16- 
1/16    7/16  -  5/16 

3/8   -  3/8  1/8  . 


C\ 

= 

1        c3 

= 

1 

T10" 

-4- 

"21 

• 

10 

ILio. 

— 

3 

yi  ~ 

3 

yz> 

_2_ 

_2_ 
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5/8" 

"-  11/16  " 

"-  1/16 

15/8 

— 

15/16* 

yi  - 

13/16 

5/4J 

L    5/8*  _ 

L-l/8 

Zoo  = 

15/4       zoi 

=  1/8 

z 

yz 


Z03  =  3/8 


With  both  Z01  and  z03  positive,  we  know  that  we  can  improve  zQ0  by 
introducing  either  yx  or  y3  as  basic  variables.  If  we  choose  to  introduce 
y3,  we  should  remove  y±,  and  this  would  take  us  immediately  to  the 
optimum  solution,  so  this  course  has  no  educational  value  for  us.  We 
elect,  therefore,  to  introduce  y\  as  the  new  basic  variable. 

Having  chosen  yx  as  the  new  variable  to  be  introduced  into  the 
basis,  which  variable  should  be  removed  from  the  basis?  We  know 
the  rule  tells  us  to  remove  the  variable  for  which  the  positive  ratio 
Zuo/zu>m+h  is  the  smallest.  But  we  have  here  a  situation  we  have  not 
previously  encountered:  a  tie,  since  15/8 -^  15/16  and  5/4^5/8  are 
both  ratios  of  2 : 1.  Each  of  these  alternatives  as  the  second-stage  solu- 
tion results  in  one  basic  variable  of  zero  value,  as  can  be  seen  from  the 
solutions  under  A  and  B. 

A: 


C2  =  1 
Cl  =  1 
C5   =    1 


3>2 

yi 
y*. 


-  4/15         2/15         1/3" 
1/15         7/15     -  1/3 
L      1/3       -  2/3  1/3. 


c* 

— 

1 

Cl 

— 

1 

T10" 

"3- 

"2" 

' 

10 

— 

4 

^4 

— 

3 

ys 

lLlO_ 

.3. 

_2_ 

B 


ci  =  1 

Ci   =    1 
Cl   =    1 


-■2- 

"    11/15" 

"      8/15  " 

2 

— 

16/15 

^4- 

13/15* 

Lo_ 

--  2/3  _ 

_-  2/3     _ 

^3 


zoo  =  4   004  =  -  2/15        203  =  4/15 


1/10    -  3/5         7/10" 

-1/2  1     -  1/2 

3/5       -  3/5         1/5  . 
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c3=  1 


no- 

"31 

"T 

' 

lo 

— 

1 

ys  - 

3 

y* 

ILio. 

_2_ 

_2_ 

T 

0 

L2. 


11/10" 

-  3/2 
8/5  . 

200  =   4     0Q5 


3* 


-1/5 
1* 
L-  1/5 

—    1/5  203 


yz 


2/5 


With  alternative  A  as  the  second-stage  solution,  despite  the  zero 
value  for  y5,  our  pivot  is  Zw.  This  means  we  should  substitute  y3  for  yi 
as  a  basic  variable  in  the  third-stage  solution.  As  we  know,  this  will 
result  in  the  optimum  solution  in  the  third  stage ;  so  degeneracy  offers 
no  obstacle  to  finding  the  optimum  solution,  if  we  choose  alternative 
A  as  the  second-stage  solution. 

With  alternative  B  as  the  second-stage  solution,  our  pivot  is  z&. 
This  means  we  should  substitute  y3  for  y±  as  a  basic  variable  in  the 
third-stage  solution.  But  this,  as  we  know,  will  result  in  unchanged 
values  for  yi  =  y2  =  2  and  a  zero  value  for  yz  in  the  third-stage  solution. 
How  can  we  be  sure  that  our  third-stage  solution  will  not  result  in  a 
z34  pivot,  that  our  fourth-stage  solution  will  not  again  result  in  a  343 
pivot,  and  so  on,  with  an  endless  bouncing  back  and  forth  between 
y3  and  y4?  Or  how  can  we  be  sure  that  our  third-stage  solution  will 
not  result  in  a  z$$  pivot  (which  would  result,  in  the  fourth-stage  solu- 
tion, in  substituting  y5  for  y&  as  the  basic  variable  with  zero  value), 
that  the  fourth-stage  solution  will  not  result  in  a  254  pivot,  that  the 
fifth-stage  solution  will  not  result  in  a  £43  pivot,  and  so  on  through  an 
endless  cycle  of  substituting  y5  for  y3,  y4  for  y6}  y3  for  y4,  and  y5  for  y3 
again,  ad  infinitum? 

Actually,  if  we  do  choose  alternative  B,  we  still  get  to  the  optimum 
solution.  The  third-stage  solution  results  in  a  zu  pivot;  so,  by  substi- 
tuting yh  for  yx  in  the  basis,  we  reach  the  optimum  solution  in  the 
fourth  stage — only  one  stage  later  than  if  we  had  chosen  alternative 
A .  Indeed,  the  probability  of  running  into  a  problem  which  will  lead 
to  a  fruitless  cycling  process  such  as  we  have  just  considered  as  a 
possibility,  is  supposed  to  be  very  small.  Nevertheless,  encountering 
the  cycling  process  is  at  least  a  possibility;  this  is  where  degeneracy 
causes  real  trouble,  and  it  is  clearly  sensible  to  do  what  one  can  to 
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protect  oneself  against  such  a  contingency,  remote  though  the  con- 
tingency may  be. 

A  method  for  coping  with  this  contingency  is  given  by  A.  Charnes.1 
To  understand  the  rationale  for  this  method,  let  us  begin  by  consider- 
ing where  our  (potential)  troubles  began.  For,  although  our  fears 
proved  groundless,  we  did  get  an  unmistakable  signal  of  at  least  the 
possibility  of  our  encountering  a  cycling  process 

This  signal  came  at  the  very  outset,  when  we  had  a  choice  between 
yi  and  yz  as  the  variable  to  be  introduced  into  the  basis  at  the  second 
stage,  and  we  made  the  poorer  choice  of  ylm  Parenthetically,  although 
there  is  no  certain  rule  for  making  the  best  choice  from  several  varia- 
bles with  z0lm+k>0,  our  choice  was  less  than  brilliant,  since  the  signal 
of  danger  was  staring  us  in  the  face  from  the  z01  column.  But  our  poor 
choice  can  be  justified  on  educational  grounds,  as  well  as  on  the 
grounds  that  the  situation  might  have  been  one  in  which  we  had  no 
choice  but  yi  (i.e.,  z03  might  have  been  negative). 

Our  signal  came  in  the  form  of  the  two  identical  positive  ratios 
Z40A41  and  £50/251.  At  this  point,  our  otherwise  infallible  rule  for  choos- 
ing the  variable  to  be  removed  from  the  basis  failed  us.  An  inevitable 
consequence  of  two  such  identical  ratios  is  that  both  of  the  basic  varia- 
bles associated  with  these  ratios  will  become  zero  in  the  next  stage — 
one  of  them  by  assumption,  and  the  other  by  virtue  of  the  inexorable 
laws  of  mathematics. 

Suppose,  for  example,  that  we  make  z4i  our  pivot.  Then,  by  assump- 
tion, y4  becomes  zero  in  the  next  stage,  and 

Z40 
y\  =  210  =  — 

241 

in  the  next  stage.  What  happens  to  y6'  (i.e.,  to  y5  in  the  next  stage)? 
We  know  that  ys'  =  z60',  and  we  know  the  rule  is  that 

I  Zu  ,m+h 

ZuO    =  ZuO Zro. 

Zr,m+h 

But  what  is  an  alternative  expression  for  zuo?  If  we  have  two  identical 
ratios,  then 

ZuO  Zro 

Zu,m+h  Zrtm-\-h 

1  A.  Charnes,  "Optimality  and  Degeneracy  in  Linear  Programming,"  Econometrics 
1952,  pp.  160-172. 
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is  a  general  statement  of  these  two  ratios,  and  we  can  thus  say  that 


Zu,m+h 

Zu0  =  zr0> 

%r  ,m+h 


Substitution  of  this  alternative  expression  for  zuq  into 

Zu  ,m+h 

Zuo'  ~  Zuo Zr0 

Zr  ,m+h 

thus  inevitably  means  that  2tt0'  =  0.  This  is,  of  course,  just  another 
way  of  saying  that  the  appearance  of  such  identical  ratios  is  no  acci- 
dent, but  can  happen  only  when  degeneracy  is  present. 

This  being  so,  and  knowing  that  degeneracy  means  a  P0  ray  cutting 
an  edge,  rather  than  passing  through  plane  surfaces,  of  some  tetra- 
hedron (where  we  are  dealing  with  a  three-dimensional  requirements 
space),  what  is  needed  is  some  method  of  temporarily  displacing  the 
P0  ray  towards  the  interior  of  the  tetrahedron,  then  replacing  the  P0 
ray  once  the  final  solution  is  reached.  Diagrammatically,  we  want  a 
method  which  will  displace  the  P0  ray  in  Diagram  6  (or,  though  less 
easily  visualized,  in  Diagram  7)  so  that  it  cuts  the  P1P2P3  and  PiP2P4 
planes,  instead  of  merely  cutting  the  P^  edge  of  the  relevant  tetra- 
hedron. At  the  same  time,  since  one  really  does  not  know  in  advance 
whether  one  is  dealing  with  a  problem  involving  degeneracy,  we  want 
a  method  which  will  not  throw  us  into  an  artificial  problem  involving 
degeneracy.  Charnes'  method  is  such. 

Charnes'  method  is  to  add  carefully  defined  polynomials  to  each  of 
the 

m 

ZU0  =   Jw 

To  grasp  the  meaning  of  the  polynomials'  definition,  consider  any 
single  row  u  («=1,  •  •  •  ,  »),  say  the  first  row  so  that  «=1,  of  the 
extended  simplex  tableau.  Perhaps  it  would  also  be  helpful  to  assume 
more  specifically  that  (a)  there  are  three  basic  variables,  so  that 
w  =  3,  and  (b)  there  are  two  non-basic  variables,  so  that  n=S.  Ex- 
pressing this  row  both  generally  and  specifically,  as  it  would  appear 
in  the  tableau,  we  have: 

yi         yi  ym  =  y*    ym+i  =  y*    Jn  =  y* 


y\   Zuo  =  ZlO      Zuu  =  Zll  =   1     0  0  Zu,m+1  —   Zli    Zun  —  Zl5 
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The  definition  of  the  polynomial  to  be  added  to  each  of  the 


ZuO 


is: 


Tu  =  zuuEu  +  zu,m+iEm+1  +  •  •  •  +  zunEn, 


u<=l 


where  E  is  a  very  small  positive  number.  The  polynomial  is  thus 
composed  of  (1+n— m)  terms:  one  for  the  basic  variable  on  the  far 
left  of  the  row,  and  one  term  for  each  of  the  (n—m)  non-basic  varia- 
bles. The  coefficients  of  these  terms  are  the  (1+n—m) 

6 

Zun 
n=>l 

in  the  row  (zuu  is,  of  course,  always  unity,  while  there  are  always  zero 
coefficients  in  that  particular  row  under  the  remaining  basic  varia- 
bles) ;  and  the  power  to  which  the  E  associated  with  each  of  these  s's 
is  raised  is  the  same  as  the  suffix  of  the  variable  heading  that  z's 
column. 

To  express  these  polynomials  with  specific  reference  to  the  case  of 
the  above  three  basic  variables  and  two  non-basic  variables: 

Ti  =  E  +  z14E4  +  2i5£5 
r2  =  £2  +  z2iE*  +  z25£5 
T3  =  £3  +  zzl&  +  z35£5 

With  the  polynomials  to  be  added  to  zu0  defined  in  this  manner,  it  is 
impossible  for  any  two  ratios,  say 

ZlO  +  T\  220  +  Ti 

and    ) 

Zl,m+1  Z2,m+1 

to  be  equal,  and  we  can  thus  reach  the  optimum  solution  without  in- 
curring the  risk  of  getting  into  a  cycling  process.  Then,  having 
reached  the  optimum  solution,  the  solution  can  be  properly  evaluated 
be  setting  £  =  0. 
This  follows  because  either 

ZlO  220 

and    

Zl,m+1  Z2,m+1 
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are  equal  ratios,  or  they  are  not  equal  ratios.  If  they  are  not  equal 
ratios,  addition  of  7\  and  T2,  respectively,  to  their  numerators  will 
not  throw  us  into  an  "artificial"  equality  of  the  ratios,  because  E  can 
be  chosen  small  enough  to  avoid  any  such  effect.  If  the  original  ratios 
are  equal,  however,  inclusion  of  the  appropriate  polynomial  in  the 
original  ratios'  respective  numerators  will  result  in  the  relative  size  of 
the  artificial  ratios  depending  on  the  lowest-power  E  to  induce  in- 
equality— this,  because  the  higher  powers  of  a  very  small  number 
will  be  relatively  unimportant.  A  unique  choice  as  to  the  variable  to 
be  removed  from  the  basis  is  thus  assured  at  every  stage. 

To  illustrate  this,  consider  once  more  the  first-stage  solution  to  our 
initial  degeneracy  problem  in  five  variables.  Adding  to  that  solution 
columns  for  the  three  basic  variables,  in  order  to  have  all  the  relevant 
portions  of  an  extended  simplex  tableau  before  us,  we  have : 

y*  y*  yh  y\  y* 


y2      220  =      5/8      Z22  =1  Z21  =    -  H/16     Z23  =    -1/16 

yk     z40  =  15/8  Z44  =1  241  =       15/16    243  =    13/16 

y5    250  =    5/4  255  =1    251  =        5/8*    Z53  =  - 1/8 

Since  we  chose  yx  as  the  new  variable  to  be  introduced  into  the  basis 
in  the  second  stage,  we  were  confronted  with  the  two  equal  ratios  of 

240  250 

—    and    —  • 

241  251 

If  we  had  added  the  above-defined  polynomials  to  the  zu0,  the 
numerators  of  the  three  ratios  would  have  been : 

y2  5/8  -  11/16E  +  £2  -     1/16E3 

y4         15/8  +  15/16E  +  13/16E3  +  £4 

yb  5/4+    5/8£  -     l/8£3    +        £5 

The  first  E  term  leaves  the  two  pertinent  ratios  unchanged,  but  the 
£3  term  makes 

250  240 
—  <—  I 

251  241 

so  we  replace  y5  with  yi  in  the  basis. 

This  is  the  beginning  of  the  alternative  B  course  we  have  previously 
considered,  but  inclusion  of  the  polynomials  will  alter  our  third-stage 
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solution  significantly,  even  though  slightly.  The  values  for  y2)  y*,  yi 
(the  new  basic  variables)  now  become : 

y2        2  +  E2  -  1/5E3  +  11/10E5 

j4        0  +        £3  +  £4-    3/2E5 

yi        2  +  E  -  1/5E3  +    8/5E5 

We  encountered  no  equal-ratio  problem  at  this  stage,  but  got  a  clear 
mandate  to  replace  y4  by  y3j  and  this  mandate  still  holds.  Originally, 
however,  we  had  ^4=0  in  this  stage,  and  now  we  have  y*>0. 

We  might  note,  parenthetically,  that,  had  the  subscripts  of  y3  and 
y5  been  reversed,  we  should  have  had  y±  <  0  (and  negative  values  for 
y  components  are  not  permissible).  This  would  follow  because  y3 
(formerly  y5)  has  the  negative  coefficient,  —3/2,  and  would  now  also 
be  associated  with  the  lowest-power  E  (E3,  rather  than  E5).  But  this 
contingency  can  always  be  avoided  by  simply  re-naming  the  basic 
variables.  Thus  y2,  y±,  and  yx  could  have  been  renamed  yh  y2,  and  y3, 
respectively.  The  lowest  power  term  in  the  old  y±  row  would  then  be 
z22E2  =  E2,  and  this  would  dwarf  all  other  higher-power  terms  of  E. 

Skipping  over  the  third-stage  solution  to  the  final  solution,  inclu- 
sion of  the  polynomials  results  in  the  following  values  for  y5}  y2, 
and  y% : 

c5  =  1         3/5        20/13  +  10/13E  +    2/13E4  +  E5 

c2  =  1         y2        10/13  -    8/13E  +  E2  +    1/13E4 

cz  =  1         yz        30/13  +  15/13E  -f  E3  +  16/13E4 

soo  =  60/13  +  17/13E  +  E2  +  E3  +  19/13E4  +  E5 

Knowing  from  the  signs  of  204  and  z01  that  this  is  the  final  solution, 
we  set  E  =  0  to  obtain  the  true  zQ0=  60/13. 

Inclusion  of  the  polynomials  in  the  successive  stages  of  the  solution 
thus  does  two  things:  (1)  it  avoids  the  possibility  of  encountering 
equal  ratios,  and  what  is  traceable  to  the  same  phenomenon  of  de- 
generacy, (2)  it  avoids  the  appearance  of  a  basic  variable  of  zero 
value — unless,  of  course,  the  final  solution  actually  should  have  a 
basic  variable  of  zero  value. 


CHAPTER  V 

Other  Difficulties 

In  addition  to  the  problem  of  degeneracy,  one  may  also  encounter: 
(a)  problems  for  which  no  finite  maximum  (minimum)  exists;  (b) 
problems  in  which  it  is  not  easy  to  find  a  basic  feasible  solution  with 
which  to  begin  the  iterative  process— and,  indeed,  it  may  even  be 
that  no  such  solution  exists.  How  to  cope  with  these  two  complica- 
tions is  the  subject  of  this  chapter. 

NO  FINITE  MAXIMUM  (MINIMUM) 

Consider  the  following  problem: 

—  2yi  +    yi  +  ys  =2 

yi  —  2y2  +  y*  =2 

y\  +    yi  —  ^5  =  5 

Maximize  y\  +  y2  +  yz  +  y± 

This  problem  has  no  finite  maximum.  In  fact,  we  could  also  use  these 
same  requirements  equations  to  illustrate  a  case  with  no  finite  mini- 
mum, if  we  changed  the  functional  to:  minimize  y2— yi.  Since  it  is 
easier  to  visualize  the  lack  of  finite  maximum,  however,  we  shall  con- 
sider the  maximization  problem. 

In  the  problem  outlined  in  the  simplex  tableau  of  Chapter  III,  we 
encountered  one  of  only  two  types  of  situations.  In  the  first  place,  we 
had  the  type  in  which  for  some  k,  z0,m+k>0,  and  for  some  u,  zu,m+k>0. 
In  the  first  stage,  for  example,  we  found  that  zo3  =  4/5,  and  z13  =  9/10. 
And,  from  this,  we  deduced  that  y3  could  profitably  be  substituted  for 
yx  as  a  basic  variable.  In  brief,  this  type  of  situation  with  respect  to 
z0,m+k  and  zu,m+k  means  the  solution  can  be  bettered,  and  tells  us 
where. 

Secondly,  we  encountered  the  type  of  situation  in  which  for  all  k, 
Zo,m+k<0.  This  type  we  did  not  encounter  until  the  final  stage,  with 
s0i=-7/6  and  z02=-S/ 12.  This  type  of  situation  with  respect  to 
the  z0,m+k  we  learned  meant  that  the  optimum  (maximum)  solution 
had  been  reached. 

There  exists  a  third  type  of  situation;  this  and  the  other  two  repre- 
sent the  three  mutually  exclusive  and  collectively  exhaustive  possi- 
bilities. This  is  the  type  in  which  for  some  k,  z0,m+k>0,  and  for  all 
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«,  zu,m+k<0.  We  are  about  to  encounter  this  type  of  situation,  and  it 
means  we  are  confronted  with  a  linear  functional  whose  "maximum" 
is  infinity.1 

To  illustrate  this,  suppose  we  begin  by  solving  for  y=(yi,  y<t,  ys), 
also  calculating  the  zu,m+k  and  Zo,m+k  as  we  do  so.  In  doing  this,  we 
find  that  (for  convenience,  the  coefficients  from  the  functional  are 
listed  on  the  left  of  the  basic  variables  and  above  the  non-basic 

variables) : 

d  =  1  c6  =  0 


*=  1 

C2   =    1 
C3=    1 


yi 
yi 
yzJ 


1/3    2/3" 

T2" 

"0" 

-    o- 

■ 

1/3    1/3    < 

2 

— 

1 

yi  - 

0 

y* 

1        1_ 

ll_5_ 

_0_ 

.-  1_ 

■    1/3; 

-1/3 

l. 


y*- 


000  =   14      Z04  =  0 


■-  2/3- 

-1/3 

.-  1     _ 

005  =    2 


y« 


With  2o4= 0,  we  conclude  that  substitution  of  y^  for  y3  as  a  basic  varia- 
ble will  neither  help  nor  hurt  our  cause.  And  this  is  precisely  right, 
for  this  substitution  would  result  in  y=(yi,  yi,  yi)  —  {\^  4,  9),  still 
leaving  s0o=14. 

More  important  for  our  problem,  with  z05  =  2>0,  we  should  think 
we  could  improve  our  functional  by  substituting  y5  for  one  of  the 
present  basic  variables.  But  all 

3 

Zub 

are  negative,  so  our  rule  for  selecting  the  variable  to  be  removed  from 
the  basis  appears  to  break  down.  In  fact,  however,  none  of  the  varia- 
bles should  be  removed,  although  y5  should  indeed  be  added.  In  brief, 
the  "optimum"  solution  involves  a  "solution"  in  (m+ 1)  variables. 

1  If  the  functional  were  to  be  minimized,  the  inequalities  involving  the  zo,m+k  should,  of 
course,  have  their  signs  reversed  for  all  three  types  of  situation.  Parenthetically,  some 
writers  (e.g.,  S.  Vajda,  The  Theory  of  Games  and  Linear  Programming  [London:  Methuen 
&  Co.  Ltd.,  1956])  define 


Zo,m+k 


/  -  CuZu,m+k         Gm+k' 


This  reverses  the  sign  signals  indicating  an  optimum  solution:  i.e.,  for  all  h,  z0,m+k<0  would 
signify  the  optimum  minimum  had  been  reached,  rather  than  the  optimum  maximum. 
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To  state  the  matter  differently,  the  following  table  of  solutions  (all 
of  which  satisfy  the  requirements  equations)  could  obviously  be  ex- 
panded indefinitely,  so  that  the  linear  functional  to  be  maximized 
tends  towards  infinity : 


yi 


y* 


3>3 


ys 


4 

1 

9 

0 

6 

2 

12 

3 

8 

3 

15 

6 

The  reason  for  this  can  be  easily  visualized  in  Diagram  8.  A  little 
intuitive  reflection  makes  it  clear  that  the  two  triangular  planes 
P1P2P3  and  P1P2P4  are  bounded  by  points,  all  four  of  which  (i.e., 


DIAGRAM    8 


P,={-2,l,l) 


Ph  P2,  Ps,  and  P4)  lie  in  the  same  plane,  and  hence  cut  into  the  all- 
positive  section  (the  interior  of  the  box)  in  our  diagram  in  such  a  way 
as  to  have  the  common  plane  section  represented  by  the  small  heavily 
lined  quadrilateral.  Through  this  quadrilateral  plane,  the  ray  from 
the  origin  to  P0  passes.  At  this  point,  we  have  a=  1/14,  whether  the 
denominator  is  the  sum  of  the  positive  values  for  y=(yi,  yi,  yz)  or 
whether  it  is  the  sum  of  the  positive  values  for  y=  (yh  y2,  yd- 
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But  y3,  Jh  and  y&  each  appear  only  once  in  different  equations,  y6 
has  a  negative  coefficient  (i.e.,  —1),  and  the  size  and  signs  of  the  yi 
and  y2  coefficients  are  such  that  we  can  assign  increasingly  greater 
values  to  y6,  with  a  resultant  increase  also  in  each  of  yly  y2,  and  3/3 
(or  of  3/1,  y2,  and  y4).  We  can  thus  view  successive  increases  in  3/5  as 
the  equivalent  of  making  b$  (which  equals  5,  when  y6  =0)  larger  and 
larger.  Thus  the  height  of  P0  can  be  expanded  indefinitely,  since  h  is 
plotted  as  the  height  of  P0.  While  this  also  raises  the  absolute  height 
at  which  the  P0  ray  cuts  the  quadrilateral  plane,  this  latter  height 
gets  smaller  and  smaller,  relative  to  the  height  of  P0,  so  that  a  gets 
smaller.  Hence  the  P0  ray  approaches  the  vertical  axis  rising  from 
the  origin  as  the  height  of  P0  approaches  infinity.  This  demonstrates 
geometrically  what  we  already  know  algebraically  to  be  so:  since 
these  successively  smaller  as  have  a  denominator  which  is  the  sum 
of  either  yh  y2,  and  y3  or  y1}  y2,  and  y4,  there  is  no  finite  maximum  to 
our  functional. 

In  addition  to  the  criterion  of  z0,m+k> 0  for  some  k  and  zu,m+k<0  for 
all  u,  as  a  means  of  recognizing  a  problem  with  no  finite  maximum, 
there  is  a  second  method  one  can  employ.  This  involves  the  introduc- 
tion of  an  artificial  constraint  with  a  single  artificial  variable,  yn+i, 
making  this  constraint: 

yi  +  •  •  •  +  yn  +  yn+i  =  ft 

where  /3  =  a  large  but  finite  number.  This  means  that,  if  a  true  opti- 
mum solution  exists,  it  will  be  accompanied  by  a  value  for  our  arti- 
ficial variable  of: 

yn+i  =  0  -  (yi  +  •  •  •  +  yn). 

The  following  is  such  a  problem,  with  y4  being  the  artificial  variable 
in  the  artificial  constraint: 

2yi  +  3y2  =6 

4?i  +    3>2  +  ll3>3  =  5 

y\  +   yi  +     3>3  +  3,4  =  0 
Maximize  3>i  +  y2  +  3^ 

Including  our  artificial  constraint,  we  have  a  problem  involving  a 
3X3  inverse  matrix,  rather  than  a  2X2  inverse  matrix.  The  final  stage 
of  the  solution  is: 
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c3=  1 

ci=  1 

~yf 

"      2/5       -  1/5       01 

"6" 

"  0" 

£2=    1 

y* 

= 

-  1/10         3/10    0    • 

5 

— 

11 

d  =  0 

-y*- 

_-  3/10     -  1/10     IJ 

X 

_  1_ 

7/5  " 

"-  11/5 

- 

= 

9/10 

— 

33/10  yz 

_/3  -  23/10. 

_  -  i/io_ 

J3 


zoo  =  23/10      Zo3  =  -  1/10 

With  Zo3  <0,  we  cannot  improve  z00  by  introducing  y3  as  a  basic  varia- 
ble, and  we  have  reached  a  finite  maximum  of  23/10  with  the  arti- 
ficial variable,  yt  =  p— 23/10,  as  it  should  do. 

On  the  other  hand,  if  we  introduce  an  artificial  variable,  y&}  into 
an  artificial  constraint  of 

yi  +  y2  +  yz  +  y*  +  y&  +  y«  =  & 
making  this  a  fourth  constraint  in  the  initial  problem  of  this  section, 
/3  will  appear  in  the  final  values  for 


yi- 


The  final  stage  of  the  solution  to  this  problem  now  becomes: 
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c5  =  o 
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P  now  appears  in  the  expression  for  each  of  the  four  variables  yh  y2,  y3, 
and  yB,  which  tells  us  there  is  no  finite  solution  to  the  problem.  In- 
deed, our  feasible  solution  column  can  be  viewed  as  four  equations 
in  the  five  unknowns  yh  y2,  y3,  y6,  and  0.  Since  y,=  1/3/3- 14/3,  when 
3/6=0,  ]S=  14,  and  each  of  the 

w  >  °- 

Therefore,  any  increase  in  |8  (over  0=14)  necessarily  means  an  im- 
proved feasible  solution  involving  an  increase  in  each  of  the  four 
variables  yu  y2,  ys,  and  y6. 

DISCOVERING  AN  INITIAL  BASIC  FEASIBLE  SOLUTION 

All  the  problems  we  have  considered  so  far  have  not  only  had  at 
least  one  basic  feasible  solution,  but  we  have  had  no  difficulty  in  dis- 
covering a  basic  feasible  solution  as  our  initial  point  of  attack  on  the 
maximization  (minimization)  of  the  functional.  A  problem  may,  how- 
ever, have  no  basic  feasible  solution,  and,  even  if  it  has,  it  may  be  far 
from  obvious  which  of  numerous  possibilities  is  such  a  solution.  It 
would  be  helpful,  therefore,  to  have  a  method  which  assured  us  of 
(a)  an  initial  point  of  attack  in  the  form  of  a  basic  feasible  solution 
and  (b)  confirmation  of  the  fact  that  no  basic  feasible  solution  exists, 
if  no  such  solution  does  exist. 

There  is  such  a  method,  and  to  understand  it  let  us  begin  by  con- 
sidering a  problem  which  has  no  basic  feasible  solution: 

(1)  2yi  +  3y2  +  4y3  =6 

(2)  4yi  -  Sy2  +  2yA  =  -  7 

Maximize  y\  —  y2 

Now  divide  (1)  by  4  (i.e.,  by  <z13)  and,  after  multiplying  (2)  by  -1 
(to  make  b2  positive),  divide  (2)  by  2  (i.e.,  by  a24).  This  gives  us: 

(1)  I/23/1  +  3/4y2  +  y*  =  3/2 

(2)'  -  2yi  +  3/2y2  -  y*  =  7/2 

Maximize  3/1  —  y2 

As  we  can  readily  see  from  Diagram  9,  this  problem  has  no  basic 
feasible  solution,  since  the  P0  ray  will  not  intersect  any  of  the  lines 
joining  Ph  P2,  P3,  and  P4.  But  we  assume  our  problem  is  too  compli- 
cated for  us  to  discover  this  by  such  a  simple  expedient. 
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On  the  other  hand,  if  y4  in  (2)'  had  been  positive  (so  that  it  lay  at 
Pa  in  Diagram  9),  the  problem  would  have  three  basic  feasible  solu- 
tions and  we  should  also  have  an  obvious  starting  point,  namely,  to 
take  y3  and  y4  as  our  initial  basic  variables.  This  suggests  a  method  for 
getting  started  on  a  problem  which  has  no  obvious  starting  point. 

In  (1)'  and  (2)'  we  have  m  (in  this  case,  of  course,  m  =  2)  equations 
with  all  bi  non-negative.  We  also  have  k<m  variables  appearing  in 
only  one  equation  and  having  a  positive  coefficient;  in  our  case,  k=\, 
since  only  yz  meets  both  of  these  specifications — and  we  might  have 
had  no  such  variables,  in  which  event  k  would  have  been  zero. 

Now  suppose  we  make  the  y,-,  appearing  in  only  one  equation  and 
having  positive  coefficients,  equal  to  h/aa  and  make  all  other  varia- 
bles zero.  In  our  example,  this  amounts  to  making  yi  =  y2  =  :y4=0, 
with  y3  having  the  value  of  3/2.  This  means  that  k  equations  will  be 
true  [(1)',  in  our  case]  and  (m—k)  equations  will  not  be  true  [(2)',  in 
our  case].  So  we  add  (m—k)  artificial  non-negative  variables,  one  per 
equation,  to  the  left  side  of  the  (m—k)  equations  not  true. 

Our  problem  now  becomes: 
(1)"  l/2yi  +  3/4y2  +  y3  =  3/2 

(2)"  -  2yi  +  3/23/2  -  y4  +  ya  =  7/2 

Maximize  yi  —  y% 

This  provides  us  with  a  starting  point,  using  y3  and  ya  as  basic  varia- 
bles. In  fact,  we  also  know  from  Diagram  9  that  there  are  three  solu- 
tions to  the  problem  involving  ya.  Still  we  obviously  do  not  want  an 
artificial  variable  in  our  final  solution,  but  need  it  (or  them)  only  to 
get  started  towards  the  final  solution. 

A  sure  way  to  avoid  having  artificial  variables  in  the  final  solution 
is  also  to  introduce  them  into  the  functional,  giving  them  coefficients 
—  M  (+M,  if  the  functional  is  to  be  minimized)  large  enough  to 
dominate  any  numbers  to  which  —M  will  be  compared.  In  our  prob- 
lem, we  know  from  (2)"  that  ya  =  7/2  +  2yl  -  3/2y2  +y±,  so  intro- 
ducing —  My a  into  the  functional  results  in  a  functional  of 

Maximize  yx  -  yi  -  M (7/2  +  2yi  -  3/2y2  +  yi) 

=  (1  -  2M)yi  -  (1  -  S/2M)y2  -  My±  -  7/2M 

If  a  feasible  solution  to  the  original  problem  exists,  we  are  now  sure 
to  discover  it.  This  is  so  because  the  functional  in  a  form  which  in- 
cludes —  My a  cannot  result  in  a  solution  which  both  includes  ya  in 
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that  solution  and  also  maximizes  the  functional.  If  —  M  is  a  large 
enough  coefficient  to  dominate  all  others  to  which  it  is  compared,  then 

—  My a  is  sure  to  do  more  harm  towards  maximizing  the  functional 
than  is  any  true  variable  which  may  enter  into  a  feasible  solution.  In 
other  words,  by  including  —Mya  in  the  functional,  the  definition  of 

—  M  makes  it  certain  that  the  simplex  method  rules  will  result  in  a 
signal  to  remove  ya  as  a  basic  variable — if  a  variable  exists  which 
will  be  signaled  into  the  basis.  Conversely,  then,  if  we  reach  a  final 
solution  which  retains  ya,  we  can  be  sure  no  feasible  solution  exists. 

To  illustrate  this  no-feasible-solution  case  with  our  present  prob- 
lem, the  first  stage  solution  is: 

-M     UJ     Lo    lj 

c\  —  1         ci  —  —  1        Ci  =  0 

ZOO  =  0         Z01  =   1  Z02  =    —   1         Z04  =  0 


Cz 


64  LINEAR  PROGRAMMING  AND  GAME  THEORY 

This  tells  us  to  substitute  yx  for  y3  in  the  second  stage,  and  this  leads 
to: 

Cz  =  0  c2  —  —  1  ca  =  0 

I  =  -  M    Vy]  =  [19/2]  -  [1]*  -  [-  9/2]*  -  [-  3* 

Zoo  =  3  Z03  =  "~ ■  2  Z02  =  —  5/2        Z04  =  0 

In  essence,  this  tells  us  that  z0o  cannot  be  increased  by  substituting 
3/2,  y3,  or  ;y4  for  yi  or  ya.  It  also  tells  us,  since  ya  remains  in  the  final  so- 
lution, that  no  feasible  solution  exists.  The  z  values  at  the  bottom 
exclude  the  imaginary  effect,  of  course,  of  multiplying  the  ya  row  by 
-M. 

Now  consider  the  following  case,  which  does  have  a  basic  feasible 
solution : 

(1)  2vi  +  3y2  +  4;y3  =6 

(2)  4;yi  -  3y2  +  Sy,  =  -  5 

Maximize  y2  —  y\ 

Dividing  (1)  by  4,  multiplying  (2)  by  —1  and  then  dividing  it  by  3, 
and  finally  adding  ya  to  (2)  we  have : 

(1)'  l/2yi  +  3/4y2  +  y*  =  3/2 

(2/  -  4/3;yi  +       y2  -y*  +  ya  =  5/3 

Maximize  (1  +  M)y2  -  (1  +  4/3Jlf)yi  -  My±  -  5/3M 

Solving  for  y3  and  ya,  we  get  the  following  first  stage  of  the  tableau, 
with  the  figures  we  imagine  multiplied  by  —  M  repeated  below  the  z 
values  at  the  bottom  (these  latter  are,  of  course,  the  —  M  part  of  the 
artificial  functional) : 


kh:  a 


cz  =  0 

Ca  =    —  M 

-  M 

c\  =  —  1  c2  =  1  Ci  =  0 


Zoo  =   0      Zoi  =    —   1  Z02  =    1  Z04  =  0 

5/3  -  4/3  1  -  1 
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Our  pivot  now  tells  us  to  introduce  y2  and  remove  ya.  Since  this  will 
provide  us,  in  the  second  stage,  with  a  true  solution,  we  could  forget 
about  ya.  Nevertheless,  let  us  include  ya  among  the  non-basic  varia- 
bles in  the  second  stage,  which  looks  like  this: 

a  =  —  1         ca  =  —  M         C4  =  0 

cs  =  o   r#i     ri/4-i     r    3/21       r-  3/4-1       p/4*i 

ZOO  =   5/3       Zoi  =    1/3      ZOa  =   —  (M  +  1)      Z04  =    1 

With  ca=—M,  and  with  —  M  dominating  all  numbers  to  which  it 
is  to  be  compared  (in  this  case,  to  z2a=  1),  we  shall  never  get  a  signal 
to  bring  ya  back  into  the  basis,  for  z0a  will  always  be  negative. 

If  we  elect  to  bring  y±  into  the  basis  in  the  third  stage,  our  pivot 
becomes  z34.  This  leads  to  the  final  solution  of: 

c\  —  —  1  cz  =  0 

Ca  =  0 

Ci  =  1 

Zoo  =2   zoi  =  —  5/3  Z03  =  —  4/3 


[3~rn-ij/3]»-Ki» 


CHAPTER  VI    . 

Duality 

The  concept  of  duality  is  important,  partially  because  it  provides 
an  additional  method  of  solving  a  linear  programming  problem,1  but, 
more  importantly  for  us,  because  it  also  makes  possible  an  under- 
standing of  the  relationship  between  linear  programming  and  game 
theory.  While  a  precise  and  mathematically  general  statement  of  the 
nature  of  duality  can  be  made  in  a  page  or  two,  an  approach  of  this 
sort  is  likely  to  be  more  confusing  than  enlightening  to  the  non- 
mathematician.  For  this  reason,  we  shall  begin  by  considering  a  spe- 
cific problem  in  linear  programming,  and  by  considering  the  dual  of 
this  problem  more  or  less  simultaneously.  To  the  extent  that  it  is 
possible  to  do  so  during  this  process,  we  shall  also  draw  certain  gen- 
eralizations as  we  go  along.  A  complete  generalization  of  the  rela- 
tionships between  dual  sets  of  equations  will  be  reserved  for  a  mathe- 
matical appendix  at  the  end  of  this  chapter. 

THE  BLENDING  PROBLEM  ONCE  MORE 

Since  linear  programming  problems  typically  begin  in  the  form  of  a 
set  of  requirements  ^equations,  in  this  major  section  of  the  present 
chapter  our  first  objective  will  be  to  get  some  insight  into  the  defined 
nature  of  dual  sets  of  inequations.  Once  one  acquires  such  an  insight, 
dual  sets  lose  much  of  their  mathematical  mystery  and  the  "remark- 
able" relationships  we  shall  "discover"  between  dual  sets  of  equations 
will  be  seen  to  be  not  so  surprising  after  all. 

But  the  matter  will  perhaps  be  more  understandable  if  we  do  not 
try  to  solve  our  linear  programming  problem  while  leaving  it  in  the 
form  of  inequations.  Consequently,  our  second  step  in  this  section 
will  be  to  turn  the  dual  sets  of  inequations  into  dual  sets  of  equations. 
At  least  superficially,  this  makes  the  problem  appear  more  compli- 
cated and  unwieldy  than  it  really  is.  There  is  not  much  danger  of  our 
being  appalled  by  this  process,  however,  if  we  begin  with  an  insight 
into  the  nature  of  dual  sets  of  inequations,  for  we  should  then  be  able 
to  see  how  the  process  of  turning  the  dual  sets  of  inequations  into 
dual  sets  of  equations  does  not  really  alter  the  fundamental  nature  of 
the  problem,  but  simply  puts  the  initial  problem  into  a  soluble  form. 

1  C.  E.  Lemke,  "The  Dual  Method  of  Solving  the  Linear  Programming  Problem," 
Naval  Research  Logistics  Quarterly,  1954,  pp.  36-47. 
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The  third  step  of  this  section  will  be  to  solve  the  dual  sets  of  the 
equations  derived  in  our  second  step.  If  we  were  not  interested  in 
acquiring  some  education  about  duality,  it  would  be  unnecessary,  of 
course,  for  us  to  do  more  than  simply  to  solve  the  maximization 
problem— for  the  minimization  dual  of  our  old  friend,  the  refinery 
blending  problem,  is  of  no  real  importance  to  the  blending  problem. 
Furthermore,  as  we  shall  see,  once  one  understands  duality,  if  one 
does  need  the  solutions  to  both  a  problem  and  its  dual  (as  one  fre- 
quently does),  one  can  get  both  solutions  simply  by  solving  one  of  the 
dual  sets.  But  this  is  by  no  means  obvious,  until  one  has  first  gone 
through  the  rather  cumbersome  process  of  solving  both  the  problem 
and  its  dual,  in  order  to  trace  the  relationships  between  the  dual  sets 
of  equations. 

Dual  sets  of  inequalities.  The  blending  problem  of  Chapter  I, 
stated  as  a  typical  linear  programming  problem  (and  as  one  in  which 
pitch,  visbreaker  feed,  and  flux  were  denoted  by  yh  y2,  and  y3,  re- 
spectively), amounted  to: 

Specifically  More  Generally 

2yi  +  y%  —  2y3  <  0  anyi  +  012^2  +  0i33>3  <  h 

yi  +  y*  —  3^3  <  0  chiyi  +  ^2^2  +  023^3  <  b2 

yi  +  y%  <    1,000  flSiyi  +  032^2  +  033^3   <    #3 

Maximize  5yi  +  4;y2  —  3yz  =  Z       Maximize  ayi  +  c2y2  +  czy%  =  Z 

This  is  a  maximization  problem  in  the  form  of  requirements  inequa- 
tions, while  its  dual  is  a  minimization  problem  in  the  same  form 
(except  that  the  inequation  sign  is  reversed  from  <  to  >). 
The  dual  of  the  maximization  problem  looks  like  this: 

Specifically  More  Generally 

2*i  +    *2  +  *3  >  5  auffi  +  021*2  +  031*3  >  Cl 

*1  +      *2  +  *3  >   4  012*1  ■+  022*2  +   032*3   >    C% 

-   2*1   -   3*2  >    ~   3  013*1  +  023*2  +   033*3   >    ^3 

Minimize  0*i  +  0*2  +  1,000*3  =  $    Minimize  &i*i  +  b2x2  +  53*s  =  f 

A  brief  comparison  of  these  dual  sets  of  inequalities  and  their  func- 
tional, at  either  the  specific  or  the  more  general  level,  reveals  the 
defined  nature  of  duality  rather  clearly.  Indeed,  given  either  state- 
ment of  the  two  problems,  the  dual  can  be  immediately  formulated 
from  the  first  statement. 
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Consider  the  three  requirements  inequations  and  the  functional  of 
the  specific  maximization  problem.  Ignoring  the  equality  and  ine- 
quality signs,  we  have  a  4X4  matrix  of  coefficients  (Z  is  also  a  co- 
efficient, since  there  can  be  only  one  maximization  value).  If  we  stand 
at  the  bottom  (or  South)  side  of  this  matrix,  we  are  looking  at  the 
problem  from  South's  viewpoint,  i.e.,  we  need  to  assign  a  y,  value  to 
each  of  thei  columns  of  coefficients  (except  the  far  right  column)  in 
such  a  way  as  to  satisfy  the  three  inequations  and  maximize  the 

functional.  .    . 

The  4X4  matrix  of  coefficients  for  the  dual  of  this  maximization 
problem  (namely,  for  the  minimization  problem)  has  exactly  the  same 
coefficients  as  has  the  maximization  problem  itself— with  one  appar- 
ent exception:  the  dual  has  the  coefficient  of  f,  rather  than  Z,  and 
this  is  actually  not  an  exception,  since  it  can  be  proved  that  Z  =  f . 
The  position  of  these  coefficients  is,  however,  different.  In  the  dual, 
the  first  column  of  coefficients  is  the  same  as  the  first  row  of  coeffi- 
cients in  the  maximization  problem;  the  second  column  in  the  dual  is 
the  same  as  the  second  row  in  the  maximization  problem,  and  so  on. 
And  the  left  side  of  the  dual's  inequations  is  >  the  right  side,  whereas 
the  left  side  of  the  inequations  of  the  maximization  problem  is  < 
the  right  side.  In  brief,  the  dual  matrix  is,  in  matrix  algebra  terminol- 
ogy, simply  the  transpose  of  the  original  matrix. 

This  transposing  of  the  original  matrix  amounts  to  our  looking  at 
the  original  matrix  from  a  different  viewpoint.  In  effect,  it  amounts 
to  our  switching  the  positions  of  the  first  and  fourth  rows  and  of  the 
second  and  third  rows,  then  turning  the  matrix  clockwise  by  90°  and 
saying  to  ourselves,  "Now  we  are  looking  at  the  matrix  from  East's 

viewpoint." 

East's  viewpoint  being  a  different  one  geographically,  and  being 
also  a  minimization  (rather  than  a  maximization)  one,  we  need  to  find 
Xi  values  for  each  of  the  *  columns  of  coefficients  (except  the  far  right 
column)  in  such  a  way  as  to  satisfy  the  three  inequations  and  mini- 
mize the  functional.  In  a  very  precisely  defined  sense,  then,  each  of 
these  two  problems  is  the  obverse  (in  the  opponent  sense)  of  the  other, 
and  the  nature  of  this  obverseness  is  what  accounts  for  the  seemingly 
remarkable  comparisons  we  shall  shortly  discover  between  the  two 

solutions. 

It  might  be  noted,  however,  that  it  is  one  thing  to  say  that  one 
might  intuitively  expect  a  relationship  between  these  two  problems 
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and  quite  another  to  say  that  the  nature  of  this  relationship  is  obvi- 
ous. To  see  the  nature  of  this  highly  useful  relationship,  we  must  solve 
the  maximization  and  minimization  problems,  and  to  do  this  we  wish 
first  to  turn  our  dual  sets  of  inequations  into  dual  sets  of  equations. 

Dual  sets  of  equations.  It  will  be  recalled  that,  in  Chapter  I,  we 
did  turn  the  maximization  problem's  set  of  inequations  into  a  set  of 
equations,  by  adding  slack  (giveaway)  variables,  to  get: 

2yi  +  y2  -  2yz  +  y*  =  0 

y\  +  y%  —  3^3         +  y*         =  ° 
yi  +  y2  +  y*  =  i,000 

By  appropriate  substitution,  it  can  be  shown  that  the  functional  to 
be  maximized  in  this  problem  can  also  be  stated : 

Maximize  —  y2  +  12v3  —  5y5 

It  will  also  be  recalled  from  Chapter  I  that  it  was  stipulated  that  the 
optimum  solution  ran  in  terms  of  y2,  y3,  and  y5  (i.e.,  in  terms  of  vis- 
breaker  feed,  flux,  and  the  gravity  giveaway  factor)  as  the  basic 
variables. 

Now  our  major  objective  in  this  chapter  is  to  see  the  relationship, 
in  both  specific  and  generalized  form,  between  the  dual  sets  of  equa- 
tions, when  we  have  reached  the  optimum  solution.  It  will  be  easier  to 
see  the  nature  of  this  relationship,  if  we  renumber  the  variables  of 
the  maximization  problem  so  that  the  basic  variables  of  the  optimum 
solution  are  changed  from  y2,  y3,  and  y5  to  yh  y2,  and  y3.  When  this  is 
done,  the  above  set  of  equations  reads  as  follows: 

Specifically  Generally 

yi  -  2y2  +2y4  +  yb  =0 

n 

y\  -  3y2  +  yz  +    yi  =0  J2  a^yj  =  bi(i  =  1,  •  •  •  ,  m) 

3=1 

yi  +   yi  +ye  =  1,000 

n 

Maximize  -  yi  +  12y2  -  5ys  Maximize  X  W 

This  being  a  maximization  problem,  we  designate  it  as  the  Max-D 
(for  Maximization  Dual)  to  distinguish  it  from  the  Min-D  (for  Mini- 
mization Dual). 
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To  get  the  Min-D  of  our  problem,  we  need  to  do  five  things,  some 
of  which  we  also  had  to  do  to  get  the  dual  set  of  inequations: 

(1)  Transpose  the  a{j  coefficients  of  the  Max-D,  i.e.,  make  the  first 
row  of  the  Max-D  matrix  of  coefficients  become  the  first 
column  of  the  Min-D  matrix,  the  second  row  of  the  Max-D 
matrix  the  second  column  of  the  Min-D  matrix,  and  so  on  for 
additional  rows  in  the  Max-D.  This  results  in  making  the 
mXn  (3X6)  matrix  of  the  Max-D  into  an  nXm  (6X3)  matrix 
for  the  Min-D. 

(2)  Assign  a  new  variable,  xn+i  (i=  1,  •  •  •  ,  m),  to  each  of  these  m 
columns  of  the  Min-D  matrix.  In  our  case,  this  means  assigning 
x6+1  =  x7,  x6+2  =  Xs,  and  x6+z  =  x9  to  the  coefficients  of  the  three 
columns  of  the  Min-D  matrix. 

We  place  no  sign  restriction  on  these  variables,  for  reasons  that 
will  be  clear  under  (4). 

(3)  Turn  the  n  rows  of  this  Min-D  into  inequalities  by  placing 
Cj(j=  1,  ...,»)  on  the  right  side  of  an  inequality  sign  for  each 
of  these  rows,  with  the  left  side  of  each  of  these  inequalities 
being  >  its  c3. 

Note  that  the  right  sides  of  these  inequalities  are  the  co- 
efficients of  the  functional  of  the  Max-D  problem. 

(4)  Subtract  one  new  variable  (with  a  coefficient  of  unity), 
Xj(j=  1,  •  •  •  ,  #),  from  each  of  the  n  rows  of  the  Min-D,  to  turn 
the  inequalities  into  equations:  xx  from  the  first  row,  x2  from 
the  second  row,  and  so  on.  We  specify  that  these  x3  must  all  be 
non-negative.  Because  of  the  >  sign  of  requirement  (3),  and 
because  of  the  specification  that  all  x3-  be  non-negative,  we  can- 
not afford  the  luxury  of  a  sign  restriction  on  the  xn+i. 

(5)  Specify  as  a  minimization  functional  for  the  Min-D  problem 
that  of  minimizing 

m 

/  j  Oi%n-\-i' 

In  brief,  the  m  coefficients  of  this  minimization  functional  come 
from  the  right  sides  of  the  m  requirements  equations  of  the 
Max-D  problem. 
Performing  these  five  operations  on  the  Max-D,  we  get  the  follow- 
ing Min-D  problem: 
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Specifically 

Generally 

#7+    #8  +  #9  — #1 

=  -1 

2#7  — 3#8                 ~^2 

=    12 

Xs                                ~*3 

=  -5 

m 

f  j  aijXn+i          Xj 

i=l 

u  - i.  • 

=  Cy 

2x7+    XS  +  X9 

-%A 

=     0 

X7 

—  x5 

=     0 

Xq 

"*6=        0 

Minimize  0x7+0x8+l,000x9 


Minimize  Jj  &i#n+< 


i=l 


In  the  Min-D,  then,  in  the  first  three  columns  we  have  the  same  a{j 
coefficients  as  in  the  three  rows  of  the  left  side  of  the  Max-D,  but  in 
the  Max-D  the  i  trndj  subscripts  designate  the  rows  and  columns,  re- 
spectively, in  the  familiar  manner,  rather  than  the  reverse  designation 
of  the  Min-D.  This  reverse  designation  is,  of  course,  the  result  of 
transposing  the  Max-D  matrix. 

A  terse  and  completely  generalized  statement  of  this  dual  set  of 
problems  is  as  follows: 

Max-D  Min-D 

Requirements  Equations 

n  » 

£  aayj  =  W*  =  1,  ■■•'•>  »*)       Z)  *ifr+i  ~  xj  =  ciU  =  *»  '  ' 

;=i  « 

Restrictions 
All  y3-  non-negative  All  x3-  non-negative 

No  sign  restriction  on  xn+, 

Functional 

n  ™ 

Maximize   £c^  Minimize    ZjbiXn+i 


,») 


JM 


1=1 


Solving  the  dual  sets.  The  maximization  problem  poses  no  new 
difficulties  for  us.  Its  solution  is: 
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ci=  -1 
c2  =  12 

cz  =  —  5 
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yi 
yi 
yzA 


0 

0 

1  " 

1/2 

0 

1/2 

3/2 

1 

1/2- 

d 


0       c6  =  0        c6  =  0 


T  °  " 

"2" 

T 

■o- 

0 

— 

1 

yi  - 

0 

y*  ~ 

0 

ye 

Ll,000_ 

.1. 

_0_ 

_i. 

-1,000" 

1  " 

0  " 

"  1  ' 

500 

— 

-1/2 

y*~ 

-1/2 

^5- 

1/2 

_  500_ 

.-  3/2. 

.-  3/2_ 

-1/2. 

^6 


zoo  =  2,500    Zo4  =  -  1/2     Zo5  =  -  3/2     z06  =  -  5/2 
This  is  clearly  an  optimum  solution: 

m  n—m 

all   yu  >  0  and  all    zo,m+&  <  0. 

u=l  k=l 

The  minimization  problem  confronts  us  with  a  new  type  of  situa- 
tion. We  have  some  variables  which  are  not  sign-restricted.  We  need 
to  rid  ourselves,  at  least  on  the  surface,  of  these  variables,  so  that  we 
can  state  the  problem  purely  in  terms  of  the  sign-restricted  Xj  varia- 
bles. This  can  be  done,  as  we  shall  now  see. 

The  minimization  problem  deals  with  a  system  of  n  (six,  in  our 
case)  equations  in  n+m  (nine,  in  our  case)  variables,  and  m  (three,  in 
our  case)  of  these  variables  are  not  sign-restricted.  By  proper  choosing 
of  m  of  these  n  equations  (i.e.,  three  of  the  six  equations),  we  can 
solve  for  the  xn+i  (i.e.,  for  x7,  xs,  and  *9)  in  terms  of  m  of  the  xj.  These 
solutions  for  our  three  xn+i  can  then  be  substituted  in  the  remaining 
(n—m)  equations.  This  will  leave  us  with  three  (or,  n—m)  equations 
in  six  (or,  n)  variables,  namely,  the  Xj  variables  which  are  sign  re- 
stricted. 

Solving  the  first  three  equations  of  the  Min-D  for  the  xn+i,  we  get: 

x7~\      [gn  =  0    g2i  =  —  1/2     g3i  =  —  3/2' 

#8       =       gl2   =  0       g22    =    0  g32    =    1 

#9J  Ul3   =   1       g23    =    1/2  g33   =    1/2         _ 


r-  r 

"1- 

■o- 

"0" 

12 

+ 

0 

*1  + 

1 

%2  + 

0 

xz 

1-5. 

.0. 

_0_ 

_1_ 

, 

or, 
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Xl  =  3/2  -  1/2*2  -  3/2*3 

*8  =  -  5  +         *3 

x9  =  5/2  +  xi  +  V2*2  +  1/2*3 
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Substituting  the  xn+i  solutions  into  the  three  remaining  Min-D  re- 
quirements equations  and  the  functional,  we  get: 

-  *x  +  1/2*2  +  3/2*3  +  *4  =  I/2 

l/2*2  +  3/2*3  +  *s  =  3/2 

-  xi  -  1/2*2  -  1/2*3  +  *e  =  5/2 
Minimize  2,500  +  1,000*1  +  500*2  +  500*3  =  do  +  <te  +  fe  +  dzxz 

While  this  problem  looks  quite  different  from  the  one  from  which  we 
have  just  derived  it,  since  there  is  nothing  mysterious  or  mathemati- 
cally wrong  about  the  substitution  process  used,  this  is  still  the  same 
problem  in  somewhat  different  dress.  Thus,  for  example,  the  initial 
functional  of  0*7+0*8+l,000*9  does  become  2,500+ l,000*i+500*2 
+500*3,  when  we  substitute  for  the  *9  of  the  initial  functional  the 
value  we  found  for  *9  in  terms  of  *i,  *2,  and  *3.  One  might  also  note, 
at  this  point,  that  the  dQ,  dh  d2,  and  dz  are  the  *oo,  yu  ?«>  and  ?•  of  our 
minimization  problem. 

A  non-mathematician  would  scarcely  suspect  from  the  formulation 
of  this  problem  that  the  minimizing  solution  is  the  one  in  which  *4 
*5,  and  *6  are  the  basic  variables,  but  such  is  the  case.  Since  the  in- 
verse matrix  of  the  matrix  of  the  coefficients  of  these  three  variables 
is  a  unit  matrix,  we  can  immediately  write  down  the  solution  as: 

di  =  1,000 


<?4  =  0 
rf6  =  0 
rf6  =  0 


*4 
*5 

L*6J 


do  =  2,500 

1/2  =  #40  =  ~  204 
3/2  =  #50  —  —  205 
.5/2    =   #60   =    ~~   Z06_ 

#oo  —  Zoo  =  2,500 
d2  =  500 

1/2   =   #42   =    ~   224 
1/2   =   #52   =    —   225 
-    1/2   =   #62   =    -   226 
#02   =   220   =    500 


*2 


—    1    =   #41  =    ~~  2l4 

0   =   #51  =    —  215      *vl 
.—    1    =   #61   =    ""  2l6 

#oi  =  2i0  =  1,000 
dz  =  500 

3/2    =   #43   =    —   234* 

3/2    =   #53   =    —   235 

—    1/2    =   #63   =    ~~  236- 

#03   =   230   =    500 


*3 
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This  is  clearly  an  optimum  (minimum)  solution: 

n— m  m 

all   xm+k  >  0  and  all    fau  >  0. 

If  we  make  a  careful  comparison  of  the  various  z  terms  in  the 
Max-D  and  Min-D  solutions,  turning  the  number  subscripts  of  those 
terms  into  their  general  form,2  we  shall  see  that  four  notable  things  are 
true: 

(1)  ^oo  =  2oo;  thus  the  optimum  solution  to  the  maximizing  problem 
is  the  same  as  the  optimum  solution  to  the  minimizing  prob- 
lem. 

(2)  $m+k,o—  —Zo,m+k',  thus  the  xm+k,o  —  —Zo,m+k- 

(3)  ^ou  =  Zuo]  thus  the  tQu  =  yu. 

(4)  tm+k,u=  -zu,m+k;  thus  the  tm+k,u  columns  are  identical  with  the 
—  zUtm+k  rows. 

If  none  of  these  things  is  a  remarkable  coincidence  resulting  from  our 
particular  example,  this  means  that  one  can  write  down  the  entire 
solution  of  either  dual  from  the  solution  of  the  other.  That  these  gen- 
eralizations are  not  a  coincidence  is  shown  in  the  appendix,  page  77. 

THE  FUNDAMENTAL  DUALITY  THEOREM 

If  the  generalizations  we  have  just  drawn  above  are  justifiable  ones 
(and  the  appendix  demonstrates  that  such  is  the  case),  we  can  im- 
mediately infer,  from  those  generalizations,  the  fundamental  duality 
theorem.  As  we  shall  learn  in  Chapters  VII  and  VIII,  this  theorem  is 
basic  to  game  theory,  and  the  fundamental  duality  theorem  states 
that,  given  two  dual  sets:  (1)  if  a  finite  solution  to  the  maximization 
(minimization)  functional  exists,  there  is  also  a  finite  solution  to  the 
minimization  (maximization)  functional;  and  (2)  the  two  optimum 

2  The  reason  why  renumbering  of  the  variables  of  the  maximization  problem  makes  it 
easier  to  see  the  relationships  between  the  optimum  maximization  and  minimization  solu- 
tions should  now  be  easily  understood.  By  this  renumbering,  it  was  possible,  for  example, 
to  emphasize  that  the  subscripts  of  the  basic  variables  of  the  former  problem's  optimum 
solution  were  precisely  the  same  as  the  subscripts  of  the  wow-basic  variables  of  the  latter 
problem's  optimum  solution.  More  generally,  and  phrased  somewhat  differently,  re- 
numbering the  variables  so  that  the  basic  variables  in  the  final  solution  of  our  maximization 
problem  are 

m 

means  that  the  basic  variables  in  the  final  solution  of  the  dual  are 


Xm+k. 

fc-i 
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solutions  will  be  equal.  The  appendix  to  this  chapter  is  really  a  proof 
of  this  theorem;  and,  accepting  for  the  moment  the  validity  of  that 
appendix  as  a  justification  for  the  above  generalizations,  we  can 
readily  see  from  those  generalizations  why  this  is  true. 

On  reaching  the  optimum  solution  for  the  maximization  problem, 
we  necessarily  had  non-negative 


yu  and  negative    Zo,m+k, 


fc=i 


for  these  are  the  prerequisites  for  an  optimum  solution  to  a  maximiza- 
tion problem.  But,  if  our  generalizations  are  valid,  this  is  just  another 
way  of  saying  that 

n—m 
$m+k  ,'0 


fc=l 


(which  necessarily  equal  the  —  Zo,m+k)  and  the 

m 

foil 
u=l 

(which  necessarily  equal  the  zu0)  are  non-negative.  Since  the  zQ,m+k 
are  non-positive,  this  means  non-negative  values  for  both  the  fm+k,o 
(i.e.,  the  basic  variables,  x,  of  the  minimization  problem)  and  the 
^0u— and  these  are  the  prerequisites  for  an  optimum  solution  to  the 
minimization  problem.  Finally,  since  the  ^00  and  the  z00  necessarily 
include  the  same  terms,  so  that  s0o=fro,  the  optimum  maximum  must 
equal  the  optimum  minimum. 

From  the  viewpoint  of  the  relationship  between  dual  problems  and 
zero-sum  two-person  games,  it  is  helpful  to  realize  that  a  more  general 
statement  than  that  of  a  zero-sum  two-person  game  (to  be  considered 
in  the  next  chapter)  is  actually  implicit  in  equations  (la),  (2a),  (7), 
and  (8).3  To  see  why  this  is  so,  we  need  only  consider  these  equations 

briefly. 

Since  each  zuo  =  yu>0  and  each  -z0,m+k=%m+k>0J  it  is  clear  from 
equations  (la)  and  (7),  respectively,  that: 

Zuo  >  S  —  zu,m+kym+k,     and,     —  Zo,m+k  >  2-<zu>™+kXu> 


&=i 


«=i 


or, 


3  Equations  (7)  and  (8)  are  the  f(x)  counterparts  of  (la)  and  (2a),  and  are  to  be  found 
in  the  Appendix  at  the  end  of  this  chapter. 
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n—m  rn 

2^,  ~  zu  ,m+kym+k  <  z«o,    and      2Li  ~  zu  ,m+kXu  >  Zo  ,m+k 
Similarly,  it  is  clear  from  equations  (2a)  and  (8)  that  we  can  specify: 

n—m 

Maximize /(y)  -  z0o  =  2  z0  ,m+kym+k} 
and 

TO 

Minimize /(x)  —  zoo  =  £)  2uo*u 

By  a  change  of  notation,  these  dual  sets  of  inequalities  and  their 
functional  can  be  put  in  a  form  which  makes  it  obvious  that  they 
represent  a  more  generalized  form  than  the  form  in  which  a  zero-sum 
two-person  game  is  stated  in  the  next  chapter. 

Suppose  we  make  the  following  change  in  notation: 

ri  =  (n  —  m)  Xi  =  xu 

OLij  =    —   Zu,m+k  *Yj   =  Zo,m+k 

Pi  =  Zuo  f(x)'  =  f(x)  —  Zoo 

yj  =  ym+k  f(yY  =  f(y)  -  z00 

The  dual  sets  of  inequalities  and  their  functional  can  now  be  stated 


as: 


X  <*nyt  <  &  2  <xij$i  >  yj 


=i 


Maximize /(y)'  =  2  TtfV  Minimize /(#)'  =  ]£&x*' 

3=1  i=l 

This,  as  will  be  clear,  is  more  general  than  a  similar  statement  for 
zero-sum  two-person  games  in  the  next  chapter.  For  this  reason,  zero- 
sum  two-person  games  are  dual  problems  in  the  same  sense  as  that  in 
which  a  simplex  tableau  refers  simultaneously  to  dual  problems.  This 
means,  as  will  be  shown  in  Chapter  VIII,  that  the  fundamental 
duality  theorem  provides  us  with  a  method  of  simultaneously  solving 
the  problem  of  both  players  in  a  zero-sum  two-person  game.  Indeed, 
it  also  means  that  the  fundamental  duality  theorem  constitutes  one 
(although  by  no  means  either  the  first  or  the  only)  proof  of  the  basic 
theorem  of  the  theory  of  games,  namely,  the  minimax  theorem. 
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APPENDIX  TO  CHAPTER  VI 
Max-D  and  Min-D  Relationship  Generalized 

The  nature  of  the  relationship  between  the  z's  of  the  Max-D  and 
the  fis  of  the  Min-D  is  the  inevitable  result  of  the  five-step  method  by 
which  we  constructed  the  Min-D  from  the  Max-D.  The  fact  that 
many  problems  are  at  least  potentially  of  this  form  (game  theory 
problems,  for  example)  indicates  that  these  problems  are  more  preva- 
lent and  more  important  than  one  might  suppose,  in  view  of  the 
exacting  requirements  for  the  existence  of  a  dual  set  of  equations.  It 
is  desirable,  therefore,  to  understand  why  our  result  was  inevitable. 

From  Chapter  III  we  know  that,  in  the  case  of  the  Max-D,  we 
have: 


(la) 


m  n—m 

yU    ~    ZuO    —    /-J  Zu  ,m+kym+k 
tt=l  h=l 


(2a)  Maximize /(;y)  =  z0o  +  J2zo,m+kym+k 

k=i 

This  is  familiar  enough  to  require  no  further  elaboration,  but  the 
Min-D  warrants  some  attention. 

A  logical  starting  point  is  to  consider  the  process  of  eliminating  the 
xn+i,  since  we  drew  no  broad  generalizations  from  that  point  on  in 
considering  our  problem.  Referring  to  the  solution  for  x7,  x8,  and  x9)  it 
is  apparent  from  the  subscripts  of  the  inverse  matrix  for  x7,  x8,  and  x9, 
from  the  unit  coefficient  of  xh  x2,  and  x3,  and  from  the  subscripts  of 
d,  c2,  and  c3,  that  we  can  generalize  the  specific  solution  given  for 
xn+i  on  page  11  as: 


(3) 


Xn+1 

~gll     '    '    '  gml  " 

-  #n+m_ 

-glm   '    '    '  gmm- 

~Ci' 

—  Cm. 

+ 

rin 

0 

_6_ 

*i+  • 

•  •  + 

"0" 

6 
_i_ 

Xm 

or,  more  succinctly, 

m 

(3a)  xn+i  =  2  (°u  +  xu)guj,  for  any  i  =  j  ==  1,  •  •  •  , 


m 
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Note  that  the  gi3-  inverse  matrix  of  (3)  is  the  inverse  of  the  transpose  of 
the  3X3  matrix  of  coefficients  associated  with  the 


of  the  maximization  problem.  The  guj  of  (3a)  represents  any  one  of  the 
j  rows  of  this  inverse  matrix,  but  this  j  must  equal  the  i  of  the  sub- 
script in  xn+i. 

Similarly,  the  subscripts  in  the  remaining  (n—m)  equations  (three, 
in  our  case)  are  such  that  we  can  generalize  the  substitution  of  the 
xn+i  into  those  equations  as: 

m 

(4)     xm+k  =  ~  cm+k  +  ]C  ai<m+kXn+i,  for  any  k  =  1,  •  •  •  ,  (n  -  m) 

Here,  aiim+k  is  any  one  of  the  three  {m-\-k)  columns  of  the  3X3  matrix 
of  coefficients  associated  with  the  three  ym+k  of  our  maximization 
problem.  It  is  in  equation  (4)  that  our  interest  largely  centers,  in  the 
sense  that  we  want  an  alternative  expression  for  its  right  side. 

On  the  right  side  of  (3),  we  have  an  alternative  expression  for  the 
xn+i,  and  there  is  also  an  obvious  alternative  expression  for  —  cm+k. 
Knowing  from  Chapter  III  that 


Z0,m+fc    —    Cm+k  2^  Cu%u  ,m+k > 


-E 

we  have: 

m 
(5)  —   Cm+k    =    ~~   Z0,m+k   ~    2^/  CUZU  ,m+k 

Derivation  of  an  alternative  expression  for 

m 

/  „  0<i,m+k 
i=\ 

is  less  obvious. 

Let  us  begin  by  considering,  from  our  specific  problem,  the  sum  of 
(^14+224+^34)  as  representative  of  the  generalized  sum  of 

m 

/  j  Zu  tm+k  • 
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The  properties  of  the  elements  of  the  inverse  matrix  entering  into  the 
determination  of  the  zu,m+k  are  such  that: 

(fll4  +  #24  +  #34)   =    (ailZU  +  #12^24  +  #13^34)   +  (#2lZl4  +  #22^24  +  #23*34) 
+   (#31*14  +  #32*24  +  #33234) 

If  we  substitute  the  specific  values  of  our  problem,  for  example,  for 
these  letter  coefficients,  we  get: 

(2  +  1  +  1)  =  (1  +  1  +  0)  +  (1  +  3/2  -  3/2)  +  (1  +  0  +  0) 
Stated  generally,  this  means  that: 

#11     '    •    •  #ml 
m 

(6)  2+1  ai,m+k    —    [Zl,m+k   '    '    '  Zmtm+k\    X 


i=l 


.air: 


-  ar 


Note  that  the  ai3-  matrix  on  the  right  is  the  transpose  of  the  3X3 
matrix  of  coefficients  associated  with  the 


of  the  maximization  problem. 

Since  substitution  of  (3),  (5),  and  (6)  into  (4)  involves  the  product 
of  the  right  sides  of  (3)  and  (6),  and  since  the  [gi3-]  matrix  of  (3)  is 
simply  the  inverse  of  the  [ai3]  matrix  of  (6),  the  substitution  results 
in: 

(m  \  m 

~   Zo,m+k   —    2-r  cuZu,m+k)    +    Z^  ZUtm+k(cu  +  Xu) ,       OT 
«=1  /  u=l 

m 

(7)    xm+k  =  —  z0,m+k  +  2  zu,m+kxu,  for  any  k  =  1,  •  •  •  ,  (n  —  m) 

Likewise,  if  we  substitute  the  right  side  of  (3)  into  the  functional 
(biyn+i-\-  •  •  •  +bmyn+m)  to  be  minimized,  we  have: 


Minimize  f(x)  = 


blgn 

•b 

igml 

bmglm   '    '    '  bmgmm_ 

1 

1 

~Ci~ 

-Cm- 

+ 

rii 

0 

_6_ 

xi  + 

•  •  •  + 

"0- 

6 
_i_ 

Xm  f 
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As  can  be  readily  verified,  however,  the  product  of  the  [biga]  and 
[cj]  matrices  necessarily  includes  exactly  the  same  terms  as  does  the 
Zoo  of  the  Max-D.  Moreover,  the  product  of  the  [biga]  and  each  of  the 
remaining  (wXl)  matrices  is  obviously  (bign-\-  •  •  •  -)rbmgim),  •  •  •  , 
(&igmi+  •  •  •  +^mm)-and  these  are  precisely  the  terms  also  for 
«io,  •  •  *  ,  Zmo.  Hence,  the  minimization  functional  can  be  expressed 
as: 


(8) 


Minimize  f(x) '  =  Zoo  +  zl  zuq%u 


M=l 


Equations  (7)  and  (8)  are,  of  course,  the  Min-D  counterparts  of 
equations  (la)  and  (2a)  of  the  Max-D.  Thus  we  have  been  able  to 
derive  (7)  and  (8)  in  such  a  way  that  all  symbols  in  them,  except  the 
x3;  correspond  to  symbols  found  in  (la)  and  (2a).  From  a  comparison 
of  (7)  and  (8)  with  (la)  and  (2a),  therefore,  it  is  clear  that  the  rela- 
tionships we  found  between  the  z's  and  the  /'s  of  our  specific  problem 
were  more  than  a  remarkable  coincidence— they  were  inevitable. 


CHAPTER  VII 
Game  Theory 

Zero-sum  two-person  games  are,  in  at  least  one  sense,  a  special  case 
of  linear  programming  problems.  But  it  is  equally  valid  to  say  that, 
in  another  sense,  such  games  are  more  complicated  than  linear  pro- 
gramming problems.  Solving  a  linear  programming  problem  involves 
solving  a  set  of  equations  for  non-negative  variables  in  such  a  way  as 
to  maximize  (minimize)  some  functional.  In  doing  so,  a  solution  to 
the  dual  set  of  equations  is  automatically  obtained;  but  this  solution 
to  the  dual  set  of  equations  is  incidental,  rather  than  being  a  funda- 
mental objective. 

Solving  a  game  also  amounts  to  solving  a  set  of  equations  for  non- 
negative  variables  in  such  a  way  as  to  maximize  (minimize)  some 
functional.  Unlike  a  linear  programming  problem,  however,  obtaining 
solutions  to  both  of  the  dual  sets  of  equations  is  the  fundamental  ob- 
jective in  solving  a  game.  In  brief,  the  solution  to  both  of  the  dual 
sets  is  indispensable  to  the  solution  of  a  game;  while,  in  linear  pro- 
gramming, the  solution  to  one  of  the  dual  sets  is  generally  only  an 
interesting  by-product  of  getting  the  solution  to  that  particular  dual 
set  in  which  one  is  interested. 

This  comparison  largely  follows  from  the  underlying  philosophy  of 
game  theory  as  to  what  constitutes  the  best  strategy  on  the  part  of 
the  opponents  in  a  game.  For  this  philosophy  underlies  the  Minimax 
Theorem,  and  the  Minimax  Theorem  accounts  for  the  importance  of 
duality  and  linear  programming  as  a  method  of  solving  games.  Con- 
sequently our  focal  points  of  interest  in  this  chapter  are  the  major 
concepts  and  philosophy  of  game  theory,  and,  given  that  philosophy, 
the  validity  of  the  Minimax  Theorem.  The  problem  of  solving  a  game 
by  turning  it  into  a  linear  programming  problem  (and,  conversely,  of 
solving  a  linear  programming  problem  by  turning  it  into  a  game)  then 
follows  logically  in  Chapters  VIII  and  IX. 

MAJOR  CONCEPTS 

Two  basic  premises  of  zero-sum  two-person  games  are  that  (1) 
both  players  are  malevolent  (i.e.,  each  is  concerned  with  maximizing 
his  own  gains,  or  minimizing  his  own  losses)  and  (2)  both  are  aware 
of,  and  intelligent  enough  to  evaluate  accurately,  the  payoffs  associ- 
ated with  both  players'  alternative  strategies. 
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The  payoffs  associated  with  the  players'  alternative  strategies  can 
be  expressed  in  the  form  of  a  payoff  matrix.  Thus  the  2X2  matrix 
below  means  that  B  can  choose  either  SBX  or  SB2,  the  two  pure  strate- 
gies associated  with  the  two  payoff  columns,  while  A  can  choose 
either  8Ai  or  8A2,  the  two  pure  strategies  associated  with  the  two 
payoff  rows.  The  payoff  will  be  the  number  at  the  point  of  juncture  of 
their  two  choices.  If  B  chooses  SB2  and  A  chooses  sAh  the  payoff  will 
be  ai2  =  2. 

If  the  numbers  represent  the  amount  A  receives,  A  would  then  win 
2,  while  B  would  lose  an  equal  amount.  There  being  no  negative  num- 
bers in  the  matrix,  this  is  a  singularly  unprofitable  game  for  B ;  but, 
in  the  interests  of  simplicity  and  with  a  philanthropic  spirit  towards 
education,  B  consents  to  play  for  us — reserving  the  right,  however, 
to  do  his  best  to  minimize  his  losses. 


3Ai 


SA: 


Col.  Max. 


Matrix  I 
(Payoffs  to  A) 

B 


sBi 


SB$ 


Row 
Min. 


an  = 
3 

012   = 

2 

«21   = 

2 

022   = 

1 

2* 


Now  if  ^4's  strategies  are  associated  with  the  payoff  rows  and  A 
wants  to  maximize  his  gains,  since  A  knows  B  wishes  to  minimize  his 
own  losses  (which  are  ^4's  gains),  A  will  be  interested  in  inspecting  the 
minimum  in  each  of  his  rows.  These  row  minima  appear  to  the  right 
of  the  matrix.  Moreover,  since  A  wants  to  maximize  his  gains,  he  will 
choose  that  strategy  which  is  associated  with  the  largest  minimum — 
namely,  sAi.  In  brief,  A  strives  for  the  maximum  of  the  minima — or, 
the  maximin. 

Conversely,  if  B's  strategies  are  associated  with  the  payoff  columns 
and  B  wants  to  minimize  his  losses,  since  B  knows  A  wishes  to  maxi- 
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mize  his  own  gains  (which  are  B's  losses),  B  will  inspect  the  maximum 
in  each  of  his  columns.  These  column  maxima  are  shown  at  the  bot- 
tom of  the  matrix.  Since  B  wants  to  minimize  his  losses,  he  will 
choose  that  strategy  which  is  associated  with  the  smallest  maximum 
— namely,  SB2.  Consequently,  B  always  strives  for  the  minimum  of 
the  maxima — or,  the  minimax. 

These  choices  by  A  and  B  do  give  us  the  juncture  of  a12  =  2  as  the 
payoff,  in  the  above  game.  Furthermore,  this  payoff  is  also  the  value 
of  the  game,  since  A  and  B  will  always  choose  JLX  and  SB2,  respectively, 
in  this  particular  game.  Hence,  in  this  particular  game,  the  a12  payoff 
also  happens  to  represent  the  value  of  the  game,  or  the  expected  value 
of  A's  gains  and  B's  losses. 

The  solution  to  a  game  is  a  statement  of  the  odds  (or  probabilities) 
which  each  player  should  assign  to  each  of  his  strategies.  Thus  the 
solution  to  the  above  game  is:  for  A,  1.0:0.0;  and  for  B,  0.0:1.0, 
meaning  that  A  will  maximize  his  gains  by  assigning  a  1.0  probability 
coefficient  to  sAi  and  that  B  will  minimize  his  losses  by  assigning  a 
probability  coefficient  of  1.0  to  SB2. 

Now  this  particular  game  is  a  rather  unique  one  in  two  respects.  In 
the  first  place,  it  hasa  saddle  point  of  a12=2.  That  is  to  say,  the  maxi- 
mum of  the  row  minima  and  the  minimum  of  the  column  maxima  are 
identically  equal  to  2.  Secondly,  dominance  is  present  for  both  A  and 
B.  In  A's  case,  ,Ai  dominates  SA2— i.e.,  ,A\  is  superior  to  SA2  in  both 
columns,  and  A  would  patently  be  foolish  ever  to  play  SA2.  And  in  B's 
case,  SB2  dominates  8Bh  so  B  would  be  foolish  ever  to  play  SBX.  This 
does  not  mean,  parenthetically,  that  dominance  is  confined  to  games 
with  a  saddle  point;  for  dominance  can  also  exist  in  a  game  which 
has  no  saddle  point. 

Given  a  game  with  a  saddle  point,  finding  the  solution  is  not  diffi- 
cult, and  that  solution  will  amount  simply  to  finding  that  pure  (i.e., 
single)  strategy  for  each  player  which  will  result  in  the  maximin 
equalling  the  minimax.  Given  a  game  with  no  saddle  point,  however, 
finding  the  solution  is  all  too  frequently  something  less  than  easy.  As 
we  shall  see,  however,  in  such  games  a  mixed  strategy  (i.e.,  a  combina- 
tion of  pure  strategies  with  a  given  frequency)1  will  result  in  the  same 
stability  (i.e.,  A's  maximin=£'s  minimax)  as  in  games  with  a  saddle 
point. 

1  Even  a  pure  strategy  can,  of  course,  be  viewed  as  a  mixed  strategy  with  zero  prob- 
ability coefficients  assigned  to  all  but  the  pure  strategy  played. 
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MATHEMATICAL  PHILOSOPHY 

If  neither  dominance  nor  a  saddle  point  is  present,  even  so  simple  a 
game  as  that  provided  by  a  2  X  2  payoff  matrix  serves  to  bring  out  the 
more  important  philosophical  features  of  game  theory.  Our  second 
matrix  represents  such  a  game. 

This  matrix  is  accompanied,  in  addition  to  the  indication  of  the 
row  minima  and  the  column  maxima,  by  a  statement  of  the  solution 
to  the  game.  Our  primary  interest  lies  in  this  solution.  More  precisely, 
we  are  interested  in  assuring  ourselves  that  the  solution  to  a  game,  in 
the  general  case,  necessarily  means  equality  between  the  minimax 
and  the  maximin.2 


A 


Matrix  II 
(Payoffs  to  A) 

B 

sBi 

Row 
Min. 

A's 
Probabilities 

sA. 


sA: 


Col.  Max. 

B's 

Probabilities: 


011  = 

1 

012   = 

5 

021    = 

3 

022   = 

2 

0.2  =  %i 


2*  0.8  =  x2 


0.6  =  yi 


0.4 


y* 


First,  however,  we  note  that  there  is  no  saddle  point.  This  is  clear 
from  the  fact  that  the  pure  maximin  (a22  =  2)  is  smaller  than  the  pure 
minimax  (a2i  =  3).  It  seems  clear  that  mixed  strategies  are  preferable 
to  pure  strategies,  in  this  game.  Suppose,  for  example,  that  B  always 
elected  sBh  his  pure  strategy  associated  with  the  pure  minimax 
column.  A  would  inevitably  become  aware  of  this  constant  pattern 
in  B's  play,  and  A  would  always  adopt  SA2,  his  pure  strategy  associ- 
ated with  the  maximin  row,  thus  assuring  himself  of  a  gain  of  3.  But 


2  This  does  not  preclude  the  possibility  of  a  game  having  more  than  one  solution  which 
will  do  this,  although  all  solutions  lead  to  the  same  value  for  the  game,  since  there  can  be 
only  one  minimax  and  only  one  maximin. 
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then  B  would  inevitably  become  aware  of  this  constant  pattern  in 
A's  play,  and  B  would  shift  to  aB2  (even  though  this  pure  strategy  is 
not  associated  with  the  pure  minimax  column),  thus  assuring  himself 
of  holding  his  losses  down  to  2.  This,  in  turn,  would  lead  to  a  shift  in 
^4's  strategy,  and  so  on.  One's  intuitive  reaction  to  all  this  is  that 
mixed  strategies  are  preferable  to  pure  strategies  and  that  the  value 
of  the  game  must  lie  somewhere  between  the  two  values  represented 
by  the  pure  maximin  and  the  pure  minimax;  and  this  is  a  valid  con- 
jecture, since  the  value  of  this  game  is  13/5. 

At  this  point,  however,  it  is  certainly  not  obvious  that  the  value 
of  this  game  is  precisely  13/5.  For  this  can  be  obvious  only  after  we 
have  rigorous  definitions  for  minimax  and  maximin  and  demonstrate 
that  they  must  be  equal.  It  is,  however,  easily  seen  that,  given  the 
mixed  strategies  for  A  and  B  indicated  above  by  A's  and  B's  probabili- 
ties, the  average  payoff  is  13/5 — even  though  we  do  not  yet  know 
that  this  is  a  stable  value.  To  see  this  clearly,  let  us  consider  it  both 
generally  and  specifically. 

We  can  represent  any  mixed  strategy  of  A  symbolically  as 
x=(xi,  -  •  •  ,  xm),  where  all 

m 
i=l 

are  non-negative  and  where  (xx+  •  •  •  +*w)  =  l;  and  we  can  repre- 
sent any  mixed  strategy  of  B  as  y  =  (yh  •  .  •  ,  yn),  where  all 


yj 

3-1 

are  non-negative  and  where  (yi+  •  •  •  +yn)  =  1.  The 

m  n 

%i  and  the  yy 

are  thus  probability  coefficients  representing  the  relative  frequency 
with  which  A  and  B  elect  to  play  each  of  their  pure  strategies.  Conse- 
quently, the  average  payoff  is 

m       n 

In  the  above  matrix,  this  amounts  to  1/5  -3/5  -1  +  1/5  -2/5  -5+4/5 
•3/5  -3+4/5  -2/5-  2  =13/5. 
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This  does  not  necessarily  mean,  however,  that  the 


and  the 


Xi 


chosen  by  A  and  B  are  necessarily  the  strategies  which  will  maximize 
A's  gains  and  minimize  B's  losses.  -4's  gains  obviously  have  to  equal 
B's  losses.  But  just  any 


yj 


will  not  be  the  mixed  strategy  which  minimizes  B's  losses,  in  which 
case  B  may  be  letting  A  get  away  with  more  than  he  should;  and  just 
any 


will  not  be  the  mixed  strategy  which  maximizes  ^4's  gains,  in  which 
case  A  may  be  letting  B  get  off  more  cheaply  than  he  should.  The 
basic  problem,  then,  is  one  of  determining  what  is  the  most  rational 
way  for  A  and  B  to  choose  their  mixed  strategies. 

Consider  the  problem  first  from  A's  viewpoint.  In  choosing  a  par- 
ticular mixed  strategy  x=(xu  •  •  •  ,  xm),  A  credits  B  with  the  intelli- 
gence to  choose  that  particular  mixed  strategy  y=  (yi,  •  •  •  ,  yn)  which 
will  minimize  the  payoff, 

i        j 

once  he  realizes  that  ^4's  strategy  is  x.  This  payoff,  to  illustrate  with 
our  2X2  matrix,  can  also  be  expressed  as: 

(1)  yifaan  +  x2a2i)  +  ^2(^1^12  +  #2^22) 

But  the  two  expressions  in  parentheses  are  the  two  column  payoffs 
associated  with  B's  two  pure  strategies,  with  each  element  of  the 
matrix  multiplied  by  the  appropriate  component  of  x.  Furthermore, 
A  may  choose  the  components  of  x  in  such  a  general  way  that  (a)  the 
first  parenthetical  expression  is  >  the  second  parenthetical  expression 
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(ie1=  1/10  and  x2=9/10,  for  example,  would  result  in  the  first  expres- 
sion being  28/10  and  the  second  expression  being  23/10),  or,  (b)  the 
first  parenthetical  expression  is  <  the  second  parenthetical  expression 
(*i  =  »2=  1/2,  for  example,  would  result  in  the  first  expression  being 
4/2  and  the  second  expression  being  7/2),  or,  (c)  the  two  parenthetical 
expressions  are  equal  (#i=l/5  and  £2  =  4/5,  for  example,  results  in 
both  expressions  being  13/5). 
Since  yi+yz=l,  the  payoff 


(  X)  X  otiy^iA , 


is  just  a  weighted  average  of  amounts 

7  j  OCittij 

i 

multiplied  by  y3-  weights  summing  to  unity.  Therefore,  the  payoff 
certainly  cannot  be  smaller  than  the  smaller  of  the  two  above  paren- 
thetical expressions.  This,  however,  is  just  another  way  of  saying  that 
there  is  at  least  one  pure  strategy  of  B  that  will  minimize  his  losses  as 
well  as  any  mixed  strategy  will,  given  A's  mixed  strategy.  More  gener- 
ally, there  will  be  at  least  one  j  for  which 

i  »         3 

or  (in  words)  at  least  one  pure  strategy  of  B  that  will  minimize  his 
losses  at  least  as  well  as  will  any  mixed  strategy  B  can  choose,  given 
A's  mixed  strategy. 

This  means  that  all  A  need  do,  in  considering  each  of  his  own 
mixed-strategy  possibilities,  is  to  note  that  particular  pure  strategy  of 
B  which  gives  B  the  smallest  loss  in  connection  with  A 's  particular 
mixed  strategy.  Since 

X  %&*]  (j  =  1>  *  *  '  i  »)? 

i 

represent  the  n  column  payoffs  associated  with  B's  n  pure  strategies 
multiplied  by  the  appropriate  components  of  ^s  particular  mixed 
strategy  of  x,  we  can  denote  the  minimum  loss  strategy  of  B  as: 

(2)  min  X  ^H  =  X  &&if<*h 

j      i  i 

the  j(x)  representing  that  pure  strategy  of  B  yielding  the  minimum 
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loss,  when  x  is  given.  To  illustrate  with  reference  to  the  three  examples 
immediately  following  the  payoff  definition  (1),  these  minimum-loss 
pure  strategies  for  B  would  be : 
(a)  where  *=(*!=  1/10;  z2=9/10: 
B's  pure  strategy  SB2,  because: 


in  2  ^-2  =  Z)  *<«*  =  23/10  <  X  WH  =  28/10 


mm 


(b)  where  x=  (xi  =  x2=  1/2): 

B's  pure  strategy  aBh  because: 

2 

min  ^  Xidii  =  2  Xidn  =  4/2  <  X)  *«fl»2  =  7/2 

1        »=l  i  % 

(c)  where  £=(#1=1/5;  x2= 4/5): 

Either  of  5's  two  pure  strategies,  since  both  yield  identical 
losses  of  13/5. 
Now  A  clearly  wants  to  maximize  this  minimum  pure  strategy 
loss, 

min  2_j  Xidij, 

3  i 

of  B,  so  A  will  choose  his  mixed  strategy 


»=1 


to  do  this  [which  means  the 


x% 


associated  with  (c)  above].  Thus,  we  can  define  the  maximin  in  which 
A  is  interested  as  t\\. 

(3)  max  min  2J  %ia*j  =  max  z2  xiam.x)  ~  Vi 

X  J  i  x  % 

This  mixed-strategy  maximin  can  clearly  not  be  smaller  than  the 

pure  maximin  (i.e.,  max  min  ai}),  which,  in  our  present  example,  is 

i        j 
2  (see  #22  of  Matrix  II).  In  other  words,  in  our  example,  we  know 
that  771  >  2. 

Having  considered  the  problem  in  detail  from  A's  viewpoint,  we 
need  hardly  do  more  than  write  down  the  results  we  should  get  from 
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considering  the  problem  from  B's  viewpoint.  B,  in  choosing  his  par- 
ticular strategy  #=($i,  •  •  •  ,  ^»),  will  realize  that  A  has  at  least  one 
pure  strategy 

3  *        3 

Since 

Z^fi,  (*  =  1,  •;  •  ,*»), 

i 

represent  the  w  row  payoffs  associated  with  i'sw  pure  strategies, 
multiplied  by  the  appropriate  components  of  B's  particular  mixed 
strategy  of  $,  the  maximum  gain  strategy  of  A  is: 

(4)  max  X  fan  =  1]  ^(v)y> 

the  £($  standing  for  the  pure  strategy  of  A  yielding  the  maximum 
gain,  when  j  is  given. 

B  wants  to  minimize  this  maximum  pure  strategy  gain, 

max  X)  $iaij, 
*       J 

of  A,  and  B  chooses  his  mixed  strategy 

n 

yj 

3=1 

to  do  this.  Hence,  the  minimax  (r)2)  in  which  B  is  interested  becomes: 

(5)  min  max  ]T)  Vi^a  =  min  X)  y&UaM  =  f2 

V         i         j     '  V         j 

This  mixed-strategy  minimax  can  clearly  not  be  greater  than  the 

pure  minimax  (i.e.,  min  max  ay),  which,  in  our  present  example,  is 

j        i 

3  (see  a2i  of  Matrix  II).  In  other  words,  in  our  example,  we  know  that 

7]2<3. 

It  is  now  clear  that  our  intuitive  feeling  (i.e.,  that  the  value  of  the 
game  must  fall  somewhere  between  2  and  3)  was  justified.  For  we 
have  the  facts  that  rji>2  and  that  r}2<3.  None  of  this  assures  us, 
however,  that  the  value  of  the  game  must  be  precisely  13/5  and  that 
this  is  a  stable  value.  These  things  can  be  true  only  if  it  can  be  shown 
that  always  r)L  =  r)2. 
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THE  MINIMAX  THEOREM 

The  minimax  theorem  states  that  always  771=772,  i.e.,  that  always 
the  maximin  =  the  minimax.  Equipped  with  the  proper  definitions 
and  philosophy  ,we  are  now  in  a  position  to  follow  a  proof  of  the  mini- 
max theorem.3  This  proof  involves  showing  that: 

(1)  771  < 772,  which  is  easily  done;  and 

(2)  77i>772,  which  is  less  easy,  since  it  requires  invoking  the  theorem 
of  the  supporting  hyperplanes  and  the  theorem  of  the  alterna- 
tive for  matrices. 

From  (1)  and  (2),  it  then  follows  that  771=772. 

7?i<772.  We  have  seen,  from  the  immediately  preceding  pages,  that:4 

(a)  min  2  ^aa  ^  EZ  ^*yj^a 

J  i  i        j 

(Given  £,  B  has  at  least  one  pure  strategy  which  will  minimize  his 
losses  as  well  as,  or  better  than,  any  mixed  strategy,  y,  he  can  choose.) 

(b)  max  X  $iaU  >  EZ  oCiSi^j 

i  j  i       J 

(Given  j,  A  has  at  least  one  pure  strategy  which  will  maximize  his 
gains  as  well  as,  or  better  than,  any  mixed  strategy,  x,  he  can  choose.) 
As  we  know,  A  wants  to  maximize  the  left  side  of  (a),  and  we  de- 
fined this  maximin  in  (3)  on  page  88  as 

max  min  ]T)  XiUij  =  max  2J  xiaij(x)  =  Vi 

X  j  i  X  i 

But  the  only  way  that  A  can  be  sure  of  doing  this  is  to  choose  that  x 
which  makes  it  a  matter  of  indifference  to  B  which  pure  strategy  B 
chooses.  Indeed,  this  is  precisely  why  A  should  choose  alternative  (c) 
on  page  88.  It  follows,  then,  that  we  can  impute  to  A  that  particular 
strategy  x  represented  by  the  left  side  of  (a),  which  will,  in  turn, 
equal  771.  And,  by  similar  reasoning,  with  reference  to  the  minimax 
definition  in  (5)  on  page  89,  we  can  assume  B's  choice  of  $  will  be  the 
one  represented  by  the  left  side  of  (b),  so  that  772= the  left  side  of  (b). 

3  The  first  proof  (and  a  rather  difficult  one)  was  given  in  1928  by  the  late  John  von 
Neumann,  "Zur  Theorie  der  Gesellschaftsspiele,"  Math.  Annalen,  1928.  A  more  elementary 
proof,  that  given  in  this  chapter,  is  to  be  found  in  von  Neumann  and  Morgenstern,  Theory 
of  Games  and  Economic  Behavior  (Princeton,  New  Jersey:  Princeton  University  Press,  1944), 
pp.  134-143;  pp.  153-155.  Other  proofs  also  exist. 

4  A  symbolic  statement  is  just  so  much  gobbledegook  to  anyone,  until  he  thoroughly 
absorbs  the  meaning  the  statement  is  intended  to  convey.  For  the  convenience  of  the 
reader,  therefore,  a  parenthetical  reminder  of  the  meaning  of  (a)  and  (b)  is  included  im- 
mediately below  (a)  and  (b). 
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But  if  771  and  772  =  the  left  sides  of  (a)  and  (b),  respectively,  and  if 
A  and  B  choose  the  particular  strategies  just  indicated  of  x  and  5?, 
we  have  that: 
(a')  li<EI  typu 

i        3 

(b')  12>EE  *di*'u 

i       3 

Since  the  right  sides  of  inequalities  (a')  and  (b')  are  identical,  it  fol- 
lows that  771  cannot  be  greater  than  772,  so  we  have  proved  that 

77i>T72.  To  show  that  t7i>t72  is  a  good  deal  more  difficult  than  to 
show  that  771  <  772.  The  difficulties  may  seem  less  complicated,  how- 
ever, if  we  begin  with  some  general  knowledge  of  how  each  successive 
step  involved  contributes  to  the  conclusion  that  771  >  772.  We  shall  con- 
sider (A)  the  theorem  of  the  supporting  hyperplanes,  because  this  is 
important  to  a  part  of  the  proof  of  (B)  the  theorem  of  the  alternative 
for  matrices.  From  the  theorem  of  the  alternative  for  matrices,  it  is 
easily  shown  (C)  that  it  is  impossible  simultaneously  that  771  <0  and 
772 >0,  or,  phrased  differently,  that  it  is  impossible  that  77i<0<772.  It 
is  then  easy  to  show  (D)  that  it  is  equally  impossible  for  r}i<k<rj2,  for 
any  value  of  k,  so  that  771  can  never  be  smaller  than  772;  hence  r]\>7]i. 
Since  we  have  previously  seen  that  771  < 772,  it  must  follow  that  771=772. 

(a)  theorem  of  the  supporting  hyperplanes 

Even  though  we  approach  the  supporting-hyperplanes  and  the  al- 
ternative-for-matrices  theorems  in  a  relatively  informal  manner, 
calling  rather  heavily  upon  our  intuition,  we  shall  still  be  forced  to 
operate  on  a  somewhat  formidable  level  of  abstraction,  if  we  are  to 
acquire  an  understanding  of  the  proof  of  the  minimax  theorem.  Since 
such  an  understanding  requires  only  that  we  be  able  to  follow  that 
proof  (rather  than  that  we  be  able  to  reproduce  it  from  memory), 
however,  this  is  not  an  insurmountable  obstacle. 

Before  turning  to  the  supporting-hyperplanes  theorem  proper,  it 
will  be  helpful  if  we  lay  three  bits  of  foundation.  The  first  of  these  will 
be  of  obvious  familiarity.  The  second  and  third  of  these,  if  they  are 
not  immediately  of  obvious  familiarity,  will  soon  be  recognized  as 
such. 

Our  first  bit  of  foundation  is  that  we  begin  with  given  values  for 
dij  (i=l,  -  -  -  j  m\  i=l,  •  •  •  ,  n) — thus,  in  Diagram  10,  we  have 
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m  =  2  and  n  =  3.  Then  a  set  (#iy,  •  •  •  ,  amj)  is  the  point  P,  in  m-dimen- 
sional  space;  thus,  for  example,  the  set  (au,  a2z)  =  3/2,  —1/2)  is  the 
point  P3  in  two-dimensional  space.  Diagram  10  is  clearly  an  old  friend, 
in  many  respects,  since  it  is  basically  the  same  as  Diagram  3  on  page 
18  of  Chapter  II. 

DIAGRAM    IO 


(Va2|) 


»(3/2»-'/2) 

The  further  point  P=(ah  •  •  •  ,  am)  belongs  to  the  convex  hull  of 
Pi,  •  •  •  ,  Pn,  if  we  can  find  non-negative  values  for  h, 

h+  -  -  •  +/»=1,  such  that 


,  tny  where 


da  coefficients) 


for  all  *=1,  •  •  •  ,  m  (i.e.,  for  each  row  of 


+tndin,  are  more  fa- 


The  point  P,  and  the  condition  a,i  =  haa+ 
miliar  than  they  may  appear  to  be. 

It  will  help  to  see  this,  if  we  get  a  good  intuitive  notion  of  what  is 
meant  more  generally  by  a  convex  hull.  In  two-dimensional  space,  if 
two  points  are  in  a  convex  hull,  so  are  all  points  on  the  straight  line 
between  these  two  points.  Thus,  for  example,  all  points  on  a  straight 
line  drawn  between  S  and  Pi  of  Diagram  10  would  obviously  be  in  the 
convex  hull  formed  by  P1P2P3.  And  in  three-dimensional  space,  if 
three  points  are  in  the  convex  hull,  so  are  all  other  points  in  the  tri- 
angular plane  delineated  by  these  three  points.  Thus,  for  example,  in 
Diagram  4  on  page  20  of  Chapter  II,  the  points  amPo,  aMPo,  and  P2 
all  lie  in  the  tetrahedron  PxP2PzP^  and  these  three  points  form  a  tri- 
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angular  plane  within  the  tetrahedron,  so  all  points  of  this  triangular 
plane  also  lie  in  the  convex  hull  of  PiP2P3P4- 

In  terms  of  Diagram  10,  to  return  to  a  two-dimensional  convex 
hull,  the  point  P=  (<h,  <h)  =  (5/6,  5/6)  belongs  (as  is  visually  obvious) 
to  the  convex  hull  Ph  P2,  P3,  and  we  can  find  non-negative  values  for 
t1}  .  .  •  ,  h,  where  h+  •  •  •  +*3  =  1,  such  that 

01  =    Mil  +   *2#12  +   ^#13 

02  =    t\(hi  +  ^2^22  +  ^#23 


or, 


5/6  =  1/3-3/2  +  1/3-   -  1/2  +  1/3-3/2 
5/6  =  1/3-3/2  +  1/3-3/2  +  1/3-  -  1/2 


for/i=/2=*3=l/3. 

At  this  point,  let  us  get  some  intuitive  feeling  for  what  this 
^_|_  .  .  .  +/B=1  actually  constitutes.  In  effect,  these  tj  are  merely 
weights  (adding  to  unity)  to  be  applied  (1)  to  each  of  the  horizontal 
components  (an,  ai2,  and  a13  in  Diagram  10)  of  Pi,  P2,  and  P3  to  get 
the  horizontal  component  of  P,  and  (2)  to  each  of  the  vertical  com- 
ponents (a2i,  <*22,  and  a23)  of  Pi,  P2,  and  P3  to  get  the  vertical  compo- 
nent of  P. 

Furthermore,  the  manner  in  which  these  weights  are  determined  is 
easily  understood,  if  we  recall  that,  by  the  definition  of  a  convex  hull, 
all  points  on  a  straight  line  between  two  points  in  that  hull  are  also  in 
that  same  hull.  Imagine,  for  example,  a  straight  line  drawn  from  Pi 
to  S,  in  Diagram  10.  This  diagram  is  so  constructed  that  P  also  lies 
on  this  imaginary  line  of  PiS.  Now  the  line  segment  SP  has  a  length 
of  V2/3,  while  the  length  of  SPi  is  y/2.  In  brief,  SP=SPl/3.  In  a 
mechanical-analogy  sense,  then,  Pi  is  "pulling"  P  one-third  of  the  dis- 
tance from  S  to  Pi.  This  is  why  h=l/3.  Similarly,  it  so  happens  in 
this  particular  case  that  both  P2  and  P3  are  also  exerting  "pulls" 
upon  P  of  one-third  each.  As  we  know  from  Chapter  II,  it  is  no  prob- 
lem to  generalize  this  straight-line  distance  concept  between  points 
to  include  three  (and  higher)  dimensions. 

Now  consider  the  point  Pr  =  (a/,  a2')  =  1,  3/2),  which  also  belongs 
(by  the  skin  of  its  teeth)  to  the  convex  hull  PiP2P3,  since 
ai>  =  3/4-3/2  +  1/4--1/2  +  0-3/2  =  1 
ai  =  3/4.3/2  +  1/4.3/2  +  0--1/2  =  3/2 

for*i=3/4;/2=l/4;/3=0. 
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In  the  mechanical-analogy  sense,  here  P3  obviously  has  no  "pull" 
on  P',  since  P'  lies  on  the  line  PiP2.  Consequently,  /3=0.  But  ^  =  3/4 
and  t2  =  1/4,  because  Pi  has  "pulled"  P'  three-fourths  of  the  distance 
away  from  P2,  while  P2  has  "pulled"  P'  one-fourth  of  the  distance 
away  from  P\. 

Now  we  can  find  a  real  similarity  between  the  P  and  the  (h,  h,  h) 
=  (1/3,  1/3,  1/3)  of  Diagram  10,  on  the  one  hand,  and  the  P0  and  the 
(yii  3%  y8)  =  (7/10,  7/10,  1/2)  entering  into  the 

10 
aP0  =  —  P0 
19 

of  Diagram  3  in  Chapter  II,  on  the  other  hand.  The  yh  y2,  and  y3  of 
Diagram  3  actually  constitute  one  set  (of  an  infinite  number  of  sets) 
of  weights,  not  adding  to  unity,  which  takes  Pi,  P2,  and  P3  into  P0. 
The  reason  y1}  y2,  and  y3  add  to  more  than  unity  is  because  P0  lies 
outside  of  P]P2P3.  If  we  "shrink"  the  sum  of  yh  y2,  and  y3  to  unity,  we 
"pull"  P0  into  P1P2P3,  in  the  sense  that  no  P0  lying  outside  of  P1P2P3 
will  satisfy  the  two  requirements  equations  on  page  17  of  Chapter  II, 
when  the  yh  y2,  and  yz  "weights"  sum  to  unity.  This  is  highly  germane 
to  our  present  objective,  since  we  shall  ultimately  wish  to  think  of 
our  ij  weights  as  y3-. 

With  this  foundation,  we  are  prepared  to  turn  to  the  theorem  of  the 
supporting  hyperplanes.  As  we  do  so,  let  us  keep  in  mind  that  our 
ultimate  objective  is  to  prove  that  Vi>rj2,  and  that  we  are  developing 
the  proofs  of  the  theorems  of  the  supporting  hyperplanes  and  of  the 
alternative  for  matrices  first  to  show  that  it  is  impossible  simultane- 
ously for  771  <0  and  r?2>0. 

The  theorem  of  the  supporting  hyperplanes  states  that  if  the  point 
0=  (0,  •  •  •  ,0)  is  not  in  the  convex  hull  Ph  •  •  •  ,  Pn,  then  there  exist 
values  s1}  •  •  •  ,  sm  such  that,  for  any  point  P  in  the  convex  hull,  we 
have 

si^i  +•'•••'  +  smam  >  0 

where  S=  (sh  •  •  •  ,  sm)  =  the  point  in  P1}  •  •  •  ,  P„  for  which  the 
square  of  the  "distance"  from  0  (that  is,  the  square  root  of  the  sum  of 
squares  of  P's  coordinates)  is  smallest. 

This  is  fairly  obvious  (at  least  intuitively)  for  m  =  2.  Thus,  in 
Diagram  10,  5=  (1/2,  1/2)  is  the  closest  point  in  PiP2P3  to  0.  And 
s1a1Jrs2a2>0  for  any  (ah  a2)  coordinates  in  PiP2P3.  Furthermore,  if 
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the  reader  tries  juggling  the  P1P2P3  triangular  plane  around,  while 
keeping  the  point  (0,  0)  out  of  the  hull,  he  should  convince  himself 
still  further  that  this  is  true.  But  what  is  here  visually  obvious  from 
m  =  2  can  be  proved  to  be  true  for  any  finite  value  for  m. 

Consider  any  point  P=(a1,  •  •  •  ,  am)  in  the  convex  hull  of 
Pu  •  •  -  ,Pn  with  reference  to  the  point  S=  ($i,  •  •  •  ,  sm),  S  being  the 
point  in  this  same  convex  hull  least  distant  from  the  point 
0=  (0,  •  •  •  ,  0).  For  every  value  for  t  between  0  and  1,  we  will  have  a 
point  with  coordinates  to«+(l-0*i  (*"=%  ■-,»),  and  this  Point 
will  also  be  in  the  convex  hull.  In  Diagram  10,  for  example,  if  /  =  0.5, 
we  should  have  a  point  P"  (not  shown  in  the  diagram)  falling  mid- 
way between  P  and  S,  since 

ai"  =  0.5-5/6  +  (1  -0.5).  1/2  =  2/3 
a2"  =  0.5-5/6  +(1  -0.5) -1/2  =  2/3, 

so  p"=(2/3,  2/3),  which  is  midway  between  5=  (1/2,  1/2)  and 
P=  (5/6,  5/6). 

P"  can  clearly  be  no  closer  than  is  S  to  0,  and  in  fact  P"  can  be 
synonymous  with  S  only  if  t=0.  Consequently,  we  can  say  that 

-  Z  N  +  (1  -  *K]2  >  I>2 
i  i 

This  inequality  can,  in  turn,  be  expanded  to 

£  [tW  +  2(taiSi  -  tHiS%)  -  2ts*  +  tW]  >  0 

i 

and  then  rearranged  and  reduced  to 

2_E  *(*  -  *)  +  E(fl.--J<)«2>0 

i  * 

Consequently,  as  t  tends  to  zero,  the  last  inequality  tends  to 
£  Ufa  -  Si)  >  0,  or  to 

i 

E  5^  >  E  ^2  >  0 

This  proves  what  we  set  out  to  prove:  namely,  that,  if  the  point 
0=  (0,  •  •  •  ,  0)  does  not  belong  to  the  convex  hull  Pi,  •  •  •  ,  P«,  then 
values  for  sh  •  •  •  ,  sm  exist  such  that,  for  any  P  in  the  convex  hull, 

we  have 

sifli  +  •  •  •  +  smam  >  0 
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(b)  theorem  oe  the  alternative  eor  matrices 


Given,  once  more,  values  ai3- 


0-1 


m;  j=l,  •  •  •  ,  n).  Con- 


sider both  the  convex  hull  formed  by  the  set  of  n  points  in  w-dimen- 
sional  space  and  the  further  points  (1,  0,  •  •  •  ,  0),  (0,  1,  0,  •  •  •  0), 
•  •  •  ,  (0,  •  •  •  ,  0,  1).  Thus,  in  both  Diagrams  10  and  11,  we  have 
3  points  in  2-dimensional  space  forming  convex  hulls,  and  the  unit 
vectors  (1,0)  and  (0,  1)  are  points  which  also  belong  to  those  convex 
hulls.  In  Diagram  11,  however,  the  point  0  belongs  to  the  convex 
hull,  whereas  it  does  not  belong  to  the  convex  hull  in  Diagram  10. 
The  theorem  of  the  alternative  for  matrices  says  that : 

(1)  if  0  and  the  unit  vectors  belong  to  the  convex  hull,  there  exists 
some  y  such  that 

(la)  anyi+  -  •  •  +ainyn<0,  for  all  i  (i.e.,  for  each  row  of  a{j 
coefficients) 

(2)  if  0  does  not  belong  to  the  convex  hull,  but  the  unit  vectors  do 
belong  to  the  convex  hull,  there  exists  some  x  such  that 

(2a)  axjXi+  •  •  •  +amjXm>0j  for  allj  (i.e.,  for  each  column  of 


an  coefficients) 


DIAGRAM 

E 


P3"(ai3>°23MI>-2) 


As  we  shall  shortly  see,  with  the  theorem  of  the  supporting  hyper- 
planes  behind  us,  we  shall  have  no  difficulty  proving  (2a).  But  (la) 
requires  a  little  more  effort. 
To  consider  (la),  illustrating  it  at  a  small-dimensional  level  with 
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Diagram  11,  if  the  point  0  belongs  to  Plf  •  •  •  ,  Pn,  then  there  are 
values  th  •■  •  -  ,  /„+»,  all  non-negative,  such  that  h+  •  •  •  +tn+m=l, 
and  such  that 

han  +  *  •  *  +  tndin  +  tn+i  =  0,  or, 

han  ~r*  *  *  *  H~  ^nfl»n  =  ~~  tn+%  ^  0 

In  Diagram  11,  for  example,  for  /=(2/18,  5/18,  5/18,  3/18,  3/18), 

we  have 

han  +  •  •  •  +  ha^  =  —  h 

2/18(1)  +  5/18(-  2)  +  5/18(1)  =  -  3/18  <  0 
or 

t\(h\  +••'•+  ^23   =    ~   h 

2/18(1)  +  5/18(1)  +  5/18(-  2)  =  -  3/18  <  0 

Alternatively,  had  we  chosen  h=h  =  0  and  computed  t1}  t2,  and  tz 
(as  weights  operating  on  the  point  0  from  Plf  P2,  and  P3)  by  the  meth- 
od we  used  in  Diagram  10,  we  should  have  gotten  (th  t2,  ts)  =  (l/2, 
1/4,  1/4),  and  these  weights  would,  of  course,  have  given  us  the 
point  (0,  0).  Thus,  in  the  former  case  we  get  that  ttan+  •  •  •  +tnain 
=  —tn+i<0,  while  in  the  latter  case  we  get  that  tiaa+  •  •  •  +tnain= 0. 
Neither  of  these  things  could  happen,  were  the  point  0  not  in  the 
convex  hull. 

Since  h+  •  •  •  +tn  is  necessarily  positive,8  we  can  say  that 


y> 


h  +  •  •  •  +  k 


satisfy  (la).  Thus,  in  our  first  example,  we  have  y—  (2/12,  5/12,  5/12) 
satisfying  auyi+  •  •  •  +aisy3<0,  for  all  i=l,  •  •  •  ,  2.  This  estab- 
lishes the  validity  of  (la). 

Now  consider  (2a),  for  which  Diagram  10  is  a  small-dimension  ex- 
ample. If  the  point  0  does  not  belong  in  the  convex  hull  of  Pi,  •  •  •  ,Pn, 
we  know  from  the  theorem  of  the  supporting  hyperplanes  that  there 
exist  values  for  S  such  that 

si0i;  +  •  •  •  +  Smdmj  >  0,  for  ally  =  1,  •  •  •  ,  n. 

5  If  all  /»  (i=l,  •  •  •  ,  n+m),  are  non-negative  and  must  add  to  unity,  fe+  •  •  •  -\-tn 
must  be  positive— otherwise,  hOii+  '  *  ■  'tna*n—  —tn+i,  only  if  /n+i=0.  But  this  would,  in 
itself,  be  a  contradiction  of  assumptions,  since  then 

n+m  n+m 

£  U  =  0,    rather  than   £  *»  =  1. 
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Since  the  unit  vectors,  by  hypothesis,  belong  in  the  convex  hull,  we 
also  know  that 

si  >  0,  •  •  •  ,  sm  >  0, 

for  this  hypothesis  places  S  in  the  all-positive-coordinates  "quad- 
rant." Consequently,  we  can  say  that 

Si 


si .+  •  *  *  +  Sm 

satisfy  (2a).  Thus,  in  our  Diagram  10  example,  not  only  S=  (1/2, 1/2) 
but  *=(l/2,  1/2)  also  satisfies  aljx1+a2jx2>0,  for  all  i=  1,  •  •  •  ,  3. 
This  establishes  the  validity  of  (2a)  and  completes  the  proof  of  the 
theorem  of  the  alternative  for  matrices. 

(c)  IMPOSSIBILITY  THAT  77i<0  <?72 

From  the  theorem  of  the  alternative  for  matrices,  if  the  point  0 
belongs  to  the  convex  hull  of  Ph  •  •  •  ,  P„,  we  have  seen  the  validity 
of  the  statement  that  for  some  y 
(la)  aayi  +  •  •  •  +  ainy»  <  0,  for  all  i 

Now  the  left  side  of  (la)  can  be  expressed  in  the  more  compact  form 
we  used  early  in  this  chapter,  and  we  can  say  that  for  some  y 

X)  aayj  ^  °» for  a11  *  (i-e-'  for  each  matrix  row) 

Consequently,  it  must  also  be  true  that 

max  23  aayj  —  0 

i 

It  necessarily  follows,  then,  that  we  can  also  say  that 

772  =  min  max  X)  2  a*fli  —  0 
y       i        %      j 

Since  we  have  proved  earlier  that  rn<r)2,  we  can  say  that,  if  the  point 
0  is  in  the  convex  hull,  it  must  follow  that  771  < 772 <0. 

On  the  other  hand,  we  also  know  from  the  theorem  of  the  alterna- 
tive for  matrices  that,  if  the  point  0  is  not  in  the  convex  hull  (so  S  is 
in  the  all-positive-coordinates  "quadrant"),  it  is  valid  to  say  that  for 
some  x 
(2a)  aijX!  +  •  •  •  +  amjxm  >  0,  for  all; 
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But  the  left  side  of  (2a)  can  also  be  expressed  more  compactly  to  say 
that  for  some  x 

X)  dux*  >  0,  for  all  j  (i.e.,  for  each  matrix  column) 

i 

Consequently,  it  is  also  true  that 

min  X)  aaxi  >  0 
j       i 

Therefore,  we  know  that 

771  =  max  min  2  23  a»*i*»  >  0 

x  j  %         j 

Again,  knowing  that  rji<rj2}  we  can  conclude  that,  if  the  point  0  is  not 
in  the  convex  hull  (so  S  is  in  the  all-positive-coordinates  "quadrant"), 
it  must  follow  that  r)2>r)i>0. 

Now  to  say,  from  the  conclusions  drawn  from  (la),  that  77i<772<0, 
and  from  the  conclusions  drawn  from  (2a),  that  r?2>^i>0,  amounts 
to  saying  that  it  is  impossible  for  771  <0  at  the  same  time  that  7?2>0. 
We  have,  then,  that  it  is  impossible  for  771  <0  <r?2.  But  this  still  leaves 
open  the  possibility  of  ?7i<772,  when  both  771  and  rj2  are  simultaneously 
either  smaller  than  or  greater  than  0. 

(d)  IMPOSSIBILITY  THAT  r)i<k<7]2 

Suppose  771  (the  maximin)  is  less  than  0  by  k,  where  k  is  any  num- 
ber. Further  suppose  that  we  add  to  each  atj  element  of  our  matrix  an 
amount  infmitesimally  smaller  than  k,  call  it  I.6  Addition  of  such  a 
constant  obviously  does  not  alter  the  solution  to  the  game,  but  it  does 
have  the  effect  of  increasing  the 

X  cLayh  for  a11  h 

3 

and  the 

22  dijXi,  for  all  j,  by  L 

i 

From  this,  it  follows  that  both  771  and  772  increase  by  k,  and  the 

6  If  Tji  were  greater  than  zero  by  k,  we  could,  of  course,  subtract  from  each  an  element 
an  amount  infinitesimally  larger  than  k  to  arrive  at  the  same  conclusion  reached  in  this 
and  the  two  immediately  following  paragraphs. 
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value  of  771  is  now  infinite simally  smaller  than  0.7  But  we  know  that  772 
cannot  be  greater  than  0,  if  771  is  smaller  than  0.  Therefore,  771  could 
have  been  no  more  than  infinitesimally  smaller  than  772,  before  k  was 
added  to  the  a^  elements  of  the  matrix.  Evidently,  then,  we  can 
conclude  that  it  is  also  true  that  it  is  impossible  for  r)i<ka,t  the  same 
time  that  772 >k.  Knowing  that  7715C772,  it  follows  that  it  must  be  true 
that  always  771  =  772.  This  is  precisely  the  statement  of  the  minimax 
theorem  we  set  out  to  prove. 

7  This  can  be  easily  visualized  with  reference  to  Diagram  11.  The  solution  to  this 
problem  is  y  —  (0,  1/2,  1/2),  strategy  No.  1  of  B  being  dominated  by  £'s  other  two  strate- 
gies, and  x=  (1/2,  1/2).  The  value  of  the  game  is  171=772=  —1/2.  If  we  add  infinitesimally 
less  than  1/2  to  each  of  the  elements  of  this  2X3  matrix,  the  convex  hull  of  P\PiP%  is  merely 
shifted  up  and  to  the  right,  until  the  new  line  joining  P2  and  Pz  falls  infinitesimally  short  of 
passing  through  the  point  0,  or  the  origin.  The  solution  remains  unaltered,  but  the  value  of 
the  game  rises  by  %. 


CHAPTER  VIII 

Games:  Their  Duality  and  Their  Solution 

It  was  suggested  in  the  preceding  chapter  that  solving  games 
having  no  saddle  point  was  frequently  difficult.  It  was  also  suggested 
that  solving  two-person  zero-sum  games  involved  the  solution  of  dual 
sets  of  equations.  In  this  chapter  we  shall  be  concerned  with  the 
related  problems  of  understanding  this  duality  nature  of  games  and 
of  seeing  how  this  makes  it  possible  to  solve  such  games  by  turning 
them  into  linear  programming  problems.  The  final  game  considered 
in  this  chapter  will  contain  the  hint  that  a  linear  programming  prob- 
lem can  also  be  turned  into  a  game,  and  this  possibility  will  be  ex- 
amined in  Chapter  IX. 

THE  DUALITY  OF  GAMES 

It  is  clear  from  what  we  learned  in  the  preceding  chapter  that, 
given  a  pay-off  matrix  and  the  choice  of  a  mixed  strategy  x  by  A,  A 
will  gain  not  less  than 

min  ^  dijXi  =  7}. 

j      i 

This  being  so,  we  can  say  that 

aijXi  +  •  •  •  +  amjXm  >  rj,  for  ally  =  1,  •  •  •  ,  n 

m 

xi +  •  •  •  +  xm  =  1,  all  Xi  >  0 
*=i 

While  rj,  which  A  naturally  wants  to  maximize,  may  not  be  posi- 
tive, we  know  we  can  make  rj  >0  by  simply  adding  an  appropriate 
constant  to  all  a^  elements,  without  altering  the  solution  (but  not  the 
value  of  the  game)  in  any  way.  With  rj  positive,  we  can  divide  each  of 
the  above  (n+ 1)  equations  through  by  rj  to  get 

X\  Xfn 

aij h  •  •  •  +  amj  —  >  1,  for  all  j  =  1,  •  •  •  ,  n 

*!+•'•■+■*■       1        „  m   ^  „ 
=  — ,  all  Xi  >  0 
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If  we  now  define  new  variables  xi,  =  xi/7])  our  system  becomes 

m 

2  UijXi'  >  1>  for  ally  =  1,  •  •  •  ,  n 


m  1 

Minimize  ^2  x/  =  —  (because  A  seeks  to  maximize  rj) 
Similarly,  we  should  get  for  B  the  following  system 


>  ,  Gijy/  <  1,  for  all  i  =  1,  •  •  ■  •  ,  m 

3=1 
n  I 

Maximize  ]>j  y/  =  —  (because  B  seeks  to  minimize  rj) 

Near  the  end  of  Chapter  VI  we  saw  that  dual  sets  of  inequalities 
and  their  functionals  could  be  stated 


»=1  3=\ 

Minimize  J^  P&t  Maximize  ^T,  y3yj 

i  J 

These  latter  two  systems  from  Chapter  VI  are  clearly  a  more  general 
statement  than  that  represented  by  the  two  above  systems  for  games. 
They  are  more  general,  since  the  right  sides  of  the  requirements  in- 
equalities have  the  more  general  coefficients  of  ft  and  y3-  (rather  than 
of  unity) ,  and  since  the  functionals  have  the  more  general  coefficients 
of  y j  and  &  (rather  than  of  unity) .  Thus  the  games  problem  is  actually 
a  special  case  of  the  more  general  case  considered  in  Chapter  VI. 

SOLUTION  OF  GAMES 

Knowing  that  a  simplex  tableau  implicitly  deals  simultaneously 
with  a  pair  of  dual  problems,  and  knowing  also  that  a  two-person 
zero-sum  game  is  a  special  case  of  this  sort,  it  is  clear  that  we  should 
be  able  to  solve  ^4's  and  Z3's  problems  simultaneously  (as  well  as 
finding  the  value  of  the  game),  by  simply  formulating  the  problem 
of  one  of  the  players  as  a  linear  programming  problem  and  solving  it. 

Consider  the  game  represented  by  the  following  payoff  matrix: 
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A 


-1 

0 

1 

0 

1 

-1 

1 

-1 

0 

A's 
probabilities 

1/3 


1/3 


1/3 


B's 

probabilities 


1/3 


1/3 


1/3 


The  value  of  this  game  is  0,  and  the  correct  solution  to  this  game  is 
one  in  which  both  A  and  B  assign  equal  weights  of  1/3  to  each  of 
their  three  pure  strategies.  We  can  readily  verify  this  by  turning  the 
game  into  a  linear  programming  problem  to  minimize  B's  loss. 

From  the  preceding  chapter,  we  know  that,  if  B  chooses  a  particular 
mixed  strategy  y,  he  can  hold  his  loss  down  at  least  as  low  as 

max  X  aayj  =  7l- 

*  3 

Consequently,  we  know  that 

onyx  +  •  •  •  dinyn  <  v,  for  all  i  =  1,  •  •  •  ,  m 

We  can  turn  this  system  of  inequalities  into  a  linear  programming 
problem  in  either  of  two  general  ways.  One  way  is  to  view  the  prob- 
lem, as  suggested  in  the  preceding  section,  as  one  of  maximizing 

1 

Ey/--; 

and  this  is  a  case  of  minimizing  rj  indirectly.  The  other  way  is  to  view 
the  problem  as  one  of  minimizing  rj  directly. 

We  cannot  use  the  former  approach  of  maximizing 

1 
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unless  r] >0;  but  we  can  assure  ourselves  that  rj >0,  by  adding  2  (in 
fact,  adding  any  number  >1  will  obviously  work,  in  this  case)  to 
each  of  the  elements  of  the  game  matrix.  If  we  do  this,  then  dividing 
the  three  resulting  new  inequalities  through  by  77,  and  if  we  finally 
add  one  additional  variable  to  each  of  these  inequalities  to  turn  them 
into  equations,  we  get: 

yi  +  2y2'  +  3y3'  +  y*  =1 

2yi'  +  3y2'  +    yj  +  y5  =1 


?3 

Syi  +    y%'  +  2yj 

Maximize  y\  +  y2'  +  y* 


+  y6=  1 

(-r) 


The  optimum  solution  to  this  problem  is  in  terms  of  y'  —  (y/,  y2',  y&) 
and  looks  as  follows: 


1 

pl'l 

"-  5/18 

1/18 

7/18 

1 

yi 

= 

1/18 

7/18 

-  5/18 

1 

U'J 

_   7/18 

-  5/18 

1/18 

T1" 

0 
T 

0 
"0" 

0 

"0" 

y 

1 

— 

0 

y4  - 

1 

y5  - 

0 

^6 

Hi. 

Lo_ 

Lo_ 

_1_ 

1/6 

1/6 

L1/6J 

1 

zoo  =  —  =  1/2 
V 


-  5/18 
1/18 
7/18J 


y* 


Z04 


Xi 


1/6 


1/181  r      7/18" 

7/18    y6  5/18    1% 

-  5/18J  L      1/18. 

Z05  =  —  xa'  =  —  1/6  zoe  =  —  x^r  —  —  1/6 

All  z0,m+k  being  negative,  we  know  we  have  an  optimum  maximiza- 
tion solution. 

Since  £00=  l/y  =  l/2,  we  know  that  the  value  of  the  new  game  (i.e., 
the  game  posed  by  adding  k  =  2  to  each  element  of  the  original 
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matrix)  is  2.  This  tells  us  that  the  value  of  the  original  game  is 
(2  —  2)  =  0.  Furthermore,  since 

<*',  tf,  »0  -■■  (-,  -i  ■-)  -  (1/6,  1/6,  1/6), 

we.  know  that  (yu  y2,  y*)  =  (1/3,  1/3,  1/3),  i.e.,  that  an  optimum 
mixed  strategy  for  £  is  to  play  each  of  his  three  strategies  1/3  of  the 
time.  Finally,  since  we  know  (from  Chapter  VI)  that  fm+kto=  —£o,m+*> 
we  also  know  that 

(*W,*0  =  (-,-,-)  =  (1/6,  1/6,  1/6), 

so  that  (*4,  *s,  *»)  =  l/3,  1/3,  1/3)  for  4's  three  strategies. 

On  the  other  hand,  if  we  choose  to  view  the  game  problem  as  one  of 
minimizing  77  directly,  the  m  inequalities  implicit  in  the  original  game 
matrix  can  immediately  be  turned  into  equations  by  adding  one  new 
variable, 


yn+i, 

*=1 


to  the  left  side  of  each  of  the  m  inequalities.  Doing  this,  and  having  also 
that  yi+  •  •  •  +yn=l,withy1,  •  •  •  ,yn>0,  along  with  the  knowledge 
that  B  wants  to  minimize  rj,1  we  can  formulate  B's  problem  as: 


y\  +  yi  +  ^3 

=  1 

y\         +  3>3  +  y* 

=  V 

yi  —  yz         +  js 

=  V 

yi  —  y2  +  y&  =  V 

Minimize  rj  for  non-negative  variables 

We  can  rid  this  system  of  77,  at  the  same  time  reducing  the  number 
of  equations  by  one,  if  we  subtract  the  second  and  third  requirements 
equations  from  the  last  requirements  equation,2  and  if  we  specify 

1 77  is  not,  of  course,  a  constant,  but  changes  with  changing  solutions  resulting  from 
changes  in  y—  (yi,  •  •  •  ,  yn)  as  we  move  towards  the  optimum  solution. 

2  Note  that  these  last  three  requirements  equations  are  so  ordered  that  the  coefficient 
in  the  first  column  of  each  equation  is  smaller  than  the  same  coefficient  of  the  next  lower 
equation.  This  results  in  our  being  sure  that,  after  the  subtraction  process,  all  of  the 
coefficients  in  the  first  column  will  be  non-negative.  The  importance  of  this  will  shortly 
become  clear. 


106 


LINEAR  PROGRAMMING  AND  GAME  THEORY 


that  we  wish  to  minimize  the  left  side  of  this  last  equation  (which 
=  rj).  B's  problem  then  becomes  the  following  typical  linear  program- 
ming problem: 

yi  +   y*  +  y%  -  1 

2yi  —      y2   —   yz  —  yA  -f  yQ   =    0 

y\  -  2y2  +  y*         -  y&  +  ye  =  0 
Minimize  yi  —  y%  +  ^6 

As  we  solve  this  problem,  we  know  that  we  shall  also  be  solving  A's 
dual  set  of  equations,  so  that  we  shall  emerge  simultaneously  with  a 
solution  to  both  ^4's  and  Z?'s  problems. 

It  actually  takes  a  rather  rare  3X3  matrix  to  get  a  game  in  which 
all  three  of  the  pure  strategies  of  both  opponents  are  active.  There  is, 
therefore,  no  reason  to  assume  that  J3's  loss  will  be  minimized  by 
choosing  yh  y2,  and  y3  as  our  basic  variables — even  though  this  is,  in 
this  case,  true. 

Suppose,  then,  that  we  choose  yi,  y4,  and  y6  as  our  initial  basic  vari- 
ables. The  matrix  of  coefficients  for  these  variables  is 


A  = 


1         0         0" 

2-1         0 

LI         0-1. 


The  left  column  of  this  matrix  is  completely  non-negative,  since  we 
ordered  our  requirements  equations  so  as  to  achieve  this  end.  Fur- 
thermore, our  choice  of  y4  and  y5  as  the  other  two  basic  variables  re- 
sults in  the  remaining  six  elements  of  the  matrix  being  such  that 
A=A~\ 

To  choose  yh  y4,  and  y5  as  our  initial  basic  variables  is,  then,  emi- 
nently sensible.  For  we  know  immediately  what  our  inverse  matrix  is, 
and  need  not  bother  to  calculate  it.  Since  the  right  side  of  our  three 
equations  is  the  vector 
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we  also  know  that  the  left  column  of  A  =A~l  represents  the  values  of 
yh  yi}  and  yb  in  the  first-stage  solution. 
Indeed,  the  first-stage  solution  is 


<4=1 

~yi~ 

_i 

0 

0" 

d  =  0 

y* 

= 

2     - 

-  1         0 

c6  =  0 

-ys- 

.1 

0     -  1. 

ci  =  1           Cz  =  0 
n  -i       r-      i-i           i-      i-i 

•■ 

i 

0 

_0_ 

— 

-  1 

.-  2_ 

yi- 

X 

-  1 
_    1_ 

:i- 

"1  ~ 

"V 

= 

2 

— 

3 

y*    - 

3 

_1_ 

-3*. 

_0_ 

^3 


^3 


^6=1 
"0 


ye 


y^ 


#00    =    1        #02  =  #2=  —  2      #03  =#3—  ~1  #06  =  #6=1 

If  we  now  choose  to  bring  y2  into  the  basis,  our  pivot  becomes 
fe  =  3,  so  we  remove  y5  in  the  second-stage  solution  ultimately  to  get 
(with  the  help  of  our  algorithms  from  the  appendix  of  Chapter  III) 


Ci=        1 
C2  =   -1 

cA  =       0" 


Cz 

=  0 

~yi~ 

"2/3" 

"1  " 

y* 

= 

1/3 

— 

0 

-y*~ 

_  1  _ 

L3*_ 

y* 


50o  =  1/3      #03  =  xz  = 
c6  =  0 

-1/3 
1/3 
-  1 

#05  =  xb  =  2/3 


^5         - 


1 

C6   =   0 

•      1/3' 

-1/3 
0  . 
:  #6  =  1/3 


ye 


This  leaves  us  with  only  one  choice  as  to  the  variable  next  to  be 
introduced  into  the  basis,  and  our  pivot  becomes  #43,  with  ;y4  the  vari- 
able to  be  removed.  This  leads  to  the  final  solution  of 
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C\  = 

1 

~yi~ 

Ci  =  - 

- 1 

72 

c3  = 

0 

L^3_ 

C4   =   0 

ri/3-i 

-•    o  - 

1/3 

— 

1/3 

?4 

Ll/3. 

L-  1/3. 

too  —  Zoo  —  0 

#04   =   #4   =    1/3 

cs  =  0 

c6  =  1 

r-  i/3-i 

~      1/31 

— 

0 

-      1/3- 

^5        - 

-1/3 
0  _ 

^6 

pot 

x$  = 

1/3           * 

06   =   #6   = 

=  1/3 

We  find  from  ^oo  =  £oo tnat  tne  vame  of  the  game  is  zero.  And  we  know 
this  is  a  stable  value,  because  the  signs  of  the  remaining  three  fs  tell 
us  that  ^oo  cannot  be  lowered  further.  Finally,  since  fo,m+k=Zm+k,o 
=  %m+k,o,  the  values  of  these  three  jPs3  represent  the  probability  values 
to  be  assigned  to  A's  three  pure  strategies  to  maximize  A's  gains; 
and  the  values  for  y1}  y2,  and  yz  are,  of  course,  JB's  probability  values 
for  his  three  pure  strategies. 
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The  duality  results  obtained  in  Chapter  VI  lead  also  to  the  con- 
verse of  the  proposition  we  have  just  considered:  not  only  is  it  possi- 
ble to  solve  a  game  by  turning  it  into  a  linear  programming  problem, 
it  is  also  possible  to  turn  a  linear  programming  problem  into  a  game, 
then  solving  the  linear  programming  problem  by  any  known  method 
of  solving  a  game.  The  primary  value  of  this  knowledge  is  that  it 
places  at  one's  disposal,  in  solving  linear  programming  problems,  all 
the  theorems  involved  in  game  theory,  in  such  instances  as  these 
theorems  would  facilitate  the  solution  of  a  linear  programming  prob- 
lem. 

Turning  a  linear  programming  problem  into  a  game,  this  game 
then  to  be  solved  by  any  known  method  of  solving  a  game,  introduces 
certain  considerations  new  to  us.  These  considerations  will  stand  out 
more  clearly  if  we  break  our  development  of  them  into  three  parts. 

3  Because  we  are  now  deducing  the  Max-D  from  the  Min-D,  rather  than  the  reverse, 
rule  (3)  on  page  74  of  Chapter  VI  changes  from  #o«=Suo  to  f  o,«+*saft»+fc.O'  Similarly,  rule  (2) 
would  be  supplanted  by  zuo=  —  fau* 
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First,  we  shall  take  the  matrix  of  coefficients  from  the  blending 
problem  of  Chapters  I  and  VI,  turn  this  matrix  into  a  4X4  game  ma- 
trix, and  then  solve  it  as  a  game.  This  will  be  a  more  complicated 
game  than  that  of  the  preceding  section  of  this  chapter;  but,  method- 
ologically speaking,  we  shall  learn  nothing  new  about  solving  a  game 
as  a  linear  programming  problem.  Nevertheless,  we  should  gain  from 
this  procedure,  for  we  shall  have  laid  a  foundation  for  more  easily 
acquiring  an  insight  into  the  process  of  turning  a  linear  programming 
problem  into  a  game. 

Second,  because  the  preceding  step  will  also  lead  us  to  the  conclu- 
sion that  solving  the  above  4X4  game  matrix  really  does  not  consti- 
tute a  solution  to  the  linear  programming  problem,  we  shall  consider 
(in  Chapter  IX)  what  is  necessary  to  turn  the  linear  programming 
problem  into  a  game  such  that  a  solution  of  that  game  actually  does 
constitute  a  solution  to  the  linear  programming  problem  as  well.  In 
effect,  this  will  amount  to  considering  the  steps  necessary  to  remedy 
the  shortcomings  of  our  4X4  game-matrix  approach. 

Finally,  although  a  game  always  has  a  solution,  a  linear  program- 
ming problem  may  sometimes  have  either  no  optimum  solution  or  an 
unbounded  set  of  optimizing  x's  or  y's,  even  if  there  is  an  optimum 
solution.  We  shall  see  (also  in  Chapter  IX)  that  attempting  to  solve 
a  linear  programming  problem  as  a  game  will  ultimately  reveal  to  us 
that  either  of  these  situations  exists,  if  such  is  in  fact  the  case. 

The  4X4  game  matrix.  Consider  the  maximization-problem  in- 
equalities and  their  functional  on  page  67  of  Chapter  VI.  If  we  sub- 
stitute the  optimizing  value  of  2,500  for  Z  in  the  functional,  we  have 
three  inequations  and  an  equation.  Now  let  us  move  the  right  side  of 
each  of  these  to  the  left  side,  changing  the  signs,  of  course,  of  these 
four  coefficients.  Then  let  us  change  all  the  signs  of  the  functional 
coefficients,  which  naturally  leaves  the  validity  of  the  functional  un- 
changed. Finally,  let  us  change  the  equality  sign  of  the  functional 
equation  to  an  ^equality  sign  of  < ,  even  though  we  know  the  <  part 
of  this  sign  is  superfluous.  We  now  have  four  inequations,  with  the 
right  sides  all  reading  <0,  and  the  left  sides  have  a  total  of  16  co- 
efficients (although  3  of  the  16  are  zeros,  and  there  is  no  variable  ex- 
plicitly associated  with  the  fourth  column  of  coefficients). 

We  can  look  at  these  16  coefficients  as  a  4X4  game  matrix.  The 
game  then  looks  as  follows,  with  its  solution  in  terms  of  A's  and  B's 
probabilities  also  given: 
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A's 
B  probabilities 

4,503 


2 

1 

-2 

0 

1 

1 

-3 

0 

1 

1 

0 

-1,000 

-5 

-4 

3 

2,500 

£'s 
probabilities 


1,000  500 


1 


15,010 

0 

7,505 
15,010 
3,002 
15,010 


1,501  1,501  1,501 


Since  A's  second  row  is  dominated  by  A's  first  row,  in  solving  this 
problem  we  could  eliminate  the  second  row.  But  we  prefer  to  do  this 
the  hard  way,  turning  the  full  4X4  game  into  a  linear  programming 
problem  of  minimizing  B's  losses. 

We  know  the  problem  can  thus  be  stated  as: 


Fi+    F2  +    F3  + 

2Fx+    F2-2F3  + 

Fi+    F2-3F3-r- 


F4 
0F4  +  F5 
0F4  +  F6 


Fi  +    F2  +  0F3  -  1,000 F4 
-  SFi  -  4F2  +  3F3  +  2,500F4 


+  F, 


+  F8 


=  1 

=  V 

=  V 

=  V 

=  *7 


Subtracting  the  second,  third,  and  fourth  equations,  successively, 
from  the  last  equation,  we  get 

Fi  +    F2  +    F3  +  F4  =1 

-  7Fi  -  5F2  +  5F3  +  2,500F4  -  F5  +  F8  =  0 

-  6F1  -  5F2  +  6F3  +  2,500F4  -  F6  +  F8  =  0 

-  6F1  -  5F2  +  3F3  +  3,500F4  -  F7  +  F8  =  0 
Minimize  -  SFi  -  4F2  +  3F3  +  2,500 F4  +  F8 

(=  ri,  which  J5  wants  to  minimize) 
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Even  this  relatively  small  4X4  game  is  a  tedious  one  to  solve.  In- 
deed this  is  still  true,  should  we  initially  guess  that  the  proper  varia- 
bles for  which  to  solve  are  F2,  F3,  F4,  and  F6.  This  is  evident  when 
we  see  the  cumbersome  inverse  matrix  in  relation  to  the  problem: 


-  4 

F2 

3 

F3 

,500 

F4 

0 

F6 

1,000 
1,501 

500 
1,501 

1 
1,501 

500 
.1,501         15,010 


3, 

497 

15 

,010 

3, 

505 

15 

,010 

8 

15 

,010 

18 

,515 

0    - 


499  ■ 
3,002 

501 
3,002 

2 
3,002 

501 
3,002. 


-  5 


Tl" 

"   11 

-  on 

r  °i 

r°i 

■ 

0 
0 

— 

-7 
-  6 

Fx  - 

-  1 

0 

F5  - 

0 
0 

F7  - 

i 
i 

F8 

Io_ 

--  6_ 

.  o_ 

_-  1_ 

_i_ 

1,000- 
1,501 

500 
1,501 

1 
1,501 

500 
.1,501 


19,509" 
15,010 
4,505 
15,010 

6 
15,010 
19,515 
15,010. 


Fi  - 


3,497" 
15,010 
3,505 
15,010 

8 
15,010 
18,515 
15,010j 


Zoo  =  0 


2oi  -  1/10 


205 


4,503 
15,010 
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0 
499  ~ 

F7  - 

1 
"       1,002" 

3,002 
501 

15,010 
1,000 

3,002 
2 

15,010 

2 

3,002 
501 

15,010 
16,010 
.      15,010. 

Z08  =  1/5 

3,002_ 

Z07  =  1/2 

All  the  z's  shown  at  the  bottom  being  positive,  we  know  we  have  an 
optimum  solution. 

Since  F6  is  not  one  of  JB's  strategies,  but  Fi(  =  0)  is,  we  get  the  Yh 
F2,  F3,  and  F4  probabilities  indicated  for  B.  Similarly,  from  the 
fundamental  duality  theorem  we  know  that  20i  =  X5,  zq5  =  X1}  z^  =  Xz, 
and  208=^4.  But  X5  is  not  one  of  A's  strategies,  although  X2  is.  At 
the  same  time,  however,  we  know  that  F6  is  X2  from  ^4's  (i.e.,  the 
dual's)  viewpoint.  Consequently,  since  F6  (or  X2)  is  a  non-basic 
variable  from  A 's  viewpoint,  F6  =  X2  =  0.  Thus  we  get  the  Xh  X2,  XS} 
and  Xi  probabilities  indicated  for  A . 

It  is  clear  that  the  probability  figures  thus  given  for  A  and  B  con- 
stitute a  solution  of  our  4X4  game.  On  the  other  hand,  we  have  not 
solved  the  linear  programming  problem  of  Chapters  I  and  VI.  If  we 
carefully  examine  our  optimum  solution  in  the  form  of  F2,  F3,  F4, 
and  F6,  however,  we  can  make  an  interesting  discovery. 

Now  F4  is,  of  course,  the  variable  associated  with  the  fourth  column 

of  our  4X4  matrix,  and 

1 
F4  = 


If  we  divide  F2,  F3,  and  F6  by 

F4 


1,501 


1,501 


we  get  F2'=  1,000,  F3'  =  500,  and  F6'  =  500.  These  are  the  values  for 
the  y1}  y2,  and  y3  solution  to  the  linear  programming  problem  on  page 
72  of  Chapter  VI.  In  brief,  these  are  the  values  for  visbreaker  feed, 
flux,  and  gravity  giveaway. 


GAMES:  DUALITY  AND  SOLUTION  113 

In  essence,  this  means  that  F2=F4yi,  73=F4;y2,  and  Y^=Y^yz. 
Similarly,  if  we  should  look  at  the  wmimization  dual  of  Chapter  VI, 
we  should  discover  that  the  Xi,  X3,  and  X6  of  our  current  4X4  game 
are,  respectively,  since  z08=X4,  actually  X4X5,  X4x6,  and  X4x4.  In 
other  words,  we  can  also  get  the  solution  to  the  minimization  dual 
of  Chapter  VI,  by  dividing  X1}  X3,  and  X5  by  X4.  Note,  however,  that 
this  is  possible  only  because  both  F4  and  X4  are  positive — an  im- 
portant point  to  be  considered  in  the  next  chapter. 

Nevertheless,  it  must  be  emphasized  that  we  could  never  have 
solved  our  true  linear  programming  problem  by  the  method  we  have 
just  used.  To  "solve"  the  linear  programming  problem  in  the  manner 
we  just  have,  we  had  to  cheat.  For,  by  placing  the  au  element  equal 
to  2,500,  we  were  putting  what  we  knew  to  be  the  optimum  solution 
into  the  matrix.  Without  knowing  that  part  of  the  solution,  we  could 
not  have  solved  our  4X4  matrix  to  get  F2,  F3,  F4,  and  F6,  and  hence 
to  get  yu  y2,  and  y3.  It  is  obviously  not  cricket  to  "solve"  a  problem 
by  starting  with  inside  knowledge  about  part  of  the  solution.  Fortu- 
nately, however,  there  is  a  legitimate  way  to  get  the  equivalent  of 
F4  and  X4  (and  hence  of  ylt  y2,  yz,  x±,  #5,  and  x6)  by  first  turning  the 
linear  programming  problem  into  a  game,  and  we  are  now  ready  to 
consider  this  method  in  Chapter  IX. 


CHAPTER  IX 

Linear  Programming  Problems  as  Games 

At  the  end  of  Chapter  VIII,  it  was  concluded  that  the  solution  to 
the  4X4  game  matrix  considered  in  the  last  section  of  that  chapter 
did  not  offer  a  true  solution  to  the  linear  programming  problem  of 
Chapter  VI,  from  which  the  4X4  game  matrix  was  drawn.  Anticipat- 
ing that  conclusion,  it  was  stated,  early  in  the  last  section  of  Chapter 
VIII,  that  Chapter  IX  would  need  to  treat  two  matters:  (1)  the 
matter  of  how  to  turn  a  linear  programming  problem  into  a  game  in 
such  a  way  that  the  solution  to  the  game  would  also  provide  us  with  a 
true  solution  to  the  linear  programming  problem,  and  (2)  the  matter 
of  how  to  recognize,  from  the  game  solution,  either  the  possible  exist- 
tence  of  no  optimum  solution  to  the  linear  programming  problem  or 
the  possibility  of  an  unbounded  set  of  optimizing  x's  or  y's,  even  if  an 
optimum  solution  does  exist.  These  two  matters  are  treated  in  the 
above  order  in  the  two  sections  of  this  chapter. 

THE  SKEW-SYMMETRIC  MATRIX 

The  initial  maximization  problem  on  page  67  of  Chapter  VI,  using 
the  y  subscripts  finally  used  on  page  69  of  Chapter  VI,  was: 

2yi  +  yi  -  2y2  <  0 
y*  +  y\  -  3y2  <  0 
y*  +  yi  <  1,000 

Maximize  5y±  +  4>>i  —  3y2  =  Z 

These  haphazard-appearing  subscripts,  as  we  know,  were  purposely 
used  in  Chapter  VI,  because  they  resulted  in  the  basic  variables  of  the 
optimum  solution  being  named  yh  y2,  and  y3  and  hence  in  the  non- 
basic  variables  being  neatly  labeled  as  ym+k  (with  m  =  3  and  k=l, 
•••,3). 

The  minimization  problem,  as  we  also  know  from  Chapter  VI,  can 
be  expressed  (also  using  the  final  x  subscripts  of  the  initial  problem  of 
Chapter  VI)  as: 

2X7  +    Xs  +  x9  >  5 

%i  +     #8  +  #9  >  4 

—  2#7  —  3#s  ^  —  3 

Minimize  l,000x9  =  fi 
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If  we  move  the  right  sides  of  both  sets  of  these  inequalities  to  the 
left  sides  of  the  inequalities,  and  if  we  change  all  the  signs  of  the 
second  set  of  inequalities  in  order  to  change  the  second  set's  inequal- 
ity sign  from  >  to  <,  we  get: 

2y4  +  yi  -  2y2  +         0  <  0 

y*  +  yi  ~  3y2  +        0  <  0 

y*  +  yi  -  1,000  <  0 

—  2*7  —    *8  —  *9  +  5  <  0 

—  X7  —    xg  —  x9  +  4  <  0 

2*7  +  3x8  -         3  <  0 

Minimize  f.  =  1,000*9  Maximize  Z  =  Sy^  +  4yi  —  3y2 

The  column  of  coefficients  just  to  the  left  of  the  inequality  signs 
has  no  unknown  variable,  but  is  a  column  of  bare  coefficients.  To 
turn  the  combined  problem  into  a  game  problem,  we  must  remedy 
this  deficiency  by  multiplying  the  last  column  by  such  an  unknown 
(say)  z.  But  we  cannot  do  this  without  distorting  our  problem  unless 
we  multiply  all  of  the  matrix  elements  by  z. 

At  the  same  time  that  we  do  this,  let  us  do  one  other  thing.  We 
know  that  when  we  reach  either  an  optimum  solution  to  a  linear  pro- 
gramming problem  or  a  solution  to  a  game,  Z  —  ^.  Therefore,  we  can 
subtract  Z  from  f,  to  get  fi—Z<0,  although  we  know  that  the  <  sign 
is  superfluous.  Thus,  even  though  we  do  not  know  the  value  for  Z 
(as  we  assumed  we  did  in  our  4X4  game  matrix),  we  can  formulate  a 
row  analogous  to  the  fourth  row  of  the  4X4  matrix,  since  we  do  know 
that  Z=>f. 

Doing  these  two  things,  and  filling  in  the  "holes"  with  zero-co- 
efficient variables,  we  emerge  with  a  system  of  seven  inequalities: 

0x7z  +  0*8z  +         0*9z  +  2y4z  +    yxz  —  2y2z  +         Oz  <  0 

0*7z  +  0*82  +         0*9z  +    y4z  +    y\Z  —  3y2z  +         Oz  <  0 

0*7z  +  0*8z  +         0*9z  +    y4z  +    yiz  +  0y2z  -  lflOOz  <  0 

—  2*7z  —    x8z  —  *9z  -f-  0;y4z  +  Oyiz  -f-  0;y2z  +         Sz  <  0 

—  x7z  —    *8z  —  *9z  -f  0y42  +  Oyiz  +  0y22  +         4z  <  0 

2*7z  +  3*82  +         0*9z  +  0y4z  +  Oyiz  +  0y2z  —         3z  <  0 

f  —  Z  =  0*7z  +  0*82  +  1,000*92  -  5y42  -  4yiz  +  3y2z  +         Oz  <  0 

Finally,  we  may  let: 
Wx  =  *7z;  W2  =  *82;  W*  =  *9z;  WA  =  y4z;  W6  =  yxz\  W6  =  y2z;  W7  =  z 
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and  add  the  restraint  that 


E  Wi  =  1, 


;=i 


with  each  Wj  non-negative.  This  gives  us: 

0Wl  +  QW2  +         0W3  +  2W,  +  1W*  -  2WQ  +         0W7  <  0 

OTFi  +  0TF2  +         OTF3  +  1J74  +  1W6  -  3WG  +         0W7  <  0 

OTFi  +  OTF2  +         0TT3  +  ITF4  +  1W5  +  0TF6  -  1,000TF7  <  0 

-  2Wi  -  1W2  -  1W*  +  OTF4  +  0W,  +  OTFe  +         5TF7  <  0 

-1TFi-1^2-         ITF3  +  OTF4  +  OTF5  +  0W6  +         W7<0 

2TFi  +  3TF2  +         OTF3  +  OTF4  +  OTF5  +  0TF6  -         3TF7  <  0 

OJFi  +  0TF2  +  1,000TF3  -  5W*  -  4TT5  +  SW6  +         0TF7  <  0 

This  system  can  clearly  be  treated  as  a  game  for  which  77  <0,  from 

JB's  viewpoint.  Setting  the  coefficients  in  the  form  of  a  game  matrix, 

we  have: 

A's 

proba- 

B  bilities: 


0 

0 

0 

2 

1 

-2 

0 

0 

0 

0 

1 

1 

-3 

0 

0 

0 

0 

1 

1 

0 

-1,000 

-2 

-1 

-1 

0 

0 

0 

5 

-1 

-1 

-1 

0 

0 

0 

4 

2 

3 

0 

0 

0 

0 

-3 

0 

0 

1,000 

-5 

-4 

3 

0 

5's 
proba-      3 


bilities:  3,010  3,010 


5  2,000     1,000  2 

0    0 


3,010 

0 

5 
3,010 

0 

2,000 
3,010 
1,000 
3,010 
2 


3,010 


3,010     3,010      3,010 
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This  table  of  coefficients  constitutes,  in  matrix  algebra  terminology,  a 
skew-symmetric  matrix — a  square  matrix  in  which  the  first  column  is 
the  same  as  the  first  row  with  signs  reversed,  and  so  on  for  the  suc- 
cessive n  columns  and  rows.  Being  square,  this  matrix  has  a  determi- 
nant, and  the  value  of  the  determinant  of  a  skew-symmetric  matrix 
is  always  zero.  So,  by  combining  the  maximization  and  minimization 
problems  of  Chapter  VI  into  a  single  problem,  we  have  constructed 
a  game  the  value  of  which  must  be  zero.  And  we  have  done  this 
without  having  to  know  the  optimum  value  for  the  functionals  from 
which  the  bottom  row  of  the  matrix  was  derived. 

We  can  now  solve  this  game  by  any  known  method.  From  the  solu- 
tion to  the  game,  we  can  then  derive  the  solution  to  the  linear  pro- 
gramming problem.  If  we  solve  this  game,  we  get  the  solution  already 
indicated  by  ^4's  and  B's  probabilities.  A  and  B  are  not,  of  course,  the 
A  and  B  of  the  4X4  matrix.  The  A  and  B  of  the  larger  matrix  are 
essentially  the  same  "person" — that  is,  the  dual  of  a  skew-symmetric 
matrix  is  itself,  so  the  first  (second,  etc.)  row  and  first  (second,  etc.) 
column  probabilities  are  necessarily  identical. 

Having  once  solved  the  game  and  hence  knowing  that 


W7 


3,010 


we  can  then  divide  TFi  to  W6  inclusive  by  z  to  get  x7  =  3/2;  #8=0; 
#9=5/2;  y4=0;  y^=  1,000;  y2  =  500.  And  with  these  values  now  ob- 
tained, we  can  readily  obtain  the  optimum  value  for  the  maximization 
and  minimization  functionals. 

In  this  particular  problem,  despite  the  lack  of  sign  restrictions  on 
x7}  x8,  and  x9,  x7  and  x9  are  the  equivalent  of  x6  and  x6  in  the  minimiza- 
tion problem  of  Chapter  VI,  as  can  be  readily  verified  by  referring  to 
page  71  of  Chapter  VI. 

Now  if  we  multiply  the  successive  coefficients  of  the  second  and 

fourth  rows  (columns)  of  the  game  matrix  by  B's  (A's)  probabilities, 

we  get  figures  <(>)  zero.  This  means  that  our  second  and  fourth 

inequalities  can  only  be  turned  into  equations  with  a  zero  value  on 

the  right  side  by  the  inclusion  of  one  additional  variable  of  positive 

value  for  each  of  these  two  equations.  Call  these  two  variables  W9 

andWV 

W9  will  have  a  value  of         > 

3,010 
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1 
while  Wu  will  have  a  value  of  • 

W9  and  Wn  are,  of  course,  y3z  and  x*z.  Dividing  these  by 

2 

W7  =  z  = j 

3,010 

we  get  y3  =  500  and  #4=  1/2.  As  we  know,  these  are  the  correct  values 
for  the  y3  and  x*  of  the  duality  problem  of  Chapter  VI. 

In  point  of  fact,  to  solve  the  linear  programming  problem  of 
Chapters  I  and  VI  by  first  turning  it  into  a  game  is  more  onerous 
than  to  handle  it  as  a  straightforward  linear  programming  problem. 
But  it  is  easy  to  construct  a  problem  for  which  this  would  not  be  so, 
and  we  have  used  the  blending  problem  only  because  it  was  a  familiar 
one,  which  made  the  relevant  comparisons  easier  to  assimilate. 

THE  CASE  OE  Z  =  0 

In  the  4X4  and  7X7  matrices  of  Chapter  VIII  and  the  preceding 
section  of  this  chapter,  it  was  found  that  F4  and  W7(  =  z)  were  both 
positive.  Since  negative  values  for  all  Wj  are  excluded  by  postulate,  z 
cannot  be  less  than  zero.  The  postulate  does  not,  however,  exclude 
the  possibility  of  2  =  0.  The  question  naturally  arises,  therefore,  as  to 
what  the  significance  may  be  of  a  zero  value  for  z,  should  such  a 
situation  arise  in  the  solution  of  a  linear  programming  problem  turned 
into  a  game. 

Any  solution  to  such  a  game  which  involves  z— 0  is  clearly  no  solu- 
tion to  the  linear  programming  problem  from  which  that  game  was 
derived.  This  follows  because  the 

m  n 

Xi  and  yj 

of  the  linear  programming  problem  can  only  be  found  by  dividing 
each  of  the  Wm+n  by  z=Wm+n+i,  and  division  by  zero  is  meaningless. 
Indeed,  if  a  solution  to  such  a  game  does  entail  z=  Wm+n+i  =  0,  and  if 
that  solution  is  an  optimal  strategy  for  the  game,  one  of  two  things  is 
true  of  the  original  linear  programming  problem:  (1)  either  the  prob- 
lem is  one  without  a  finite  maximum  (minimum)  solution  for  the 
functional,  or  (2)  there  is  a  finite  maximum  (minimum)  solution  for 
that  functional,  but  the  set  of  x's  or  y's  involved  in  this  optimal  solu- 
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tion  is  unbounded.  Let  us  consider  an  example  of  each  of  these  two 
possibilities,  in  order  to  make  these  clearer. 

No  finite  solution.  A  case  involving  no  finite  minimum  is  provided 

by: 

2xx-    x2>  -  2 

—  xi  +  2x2  >  —  2 

%1  +     X2  >  5 

Minimize  —  %\  +  #2 

This  is  actually  the  initial  no-finite-maximum  problem  of  Chapter  V, 
with  all  of  the  signs  of  the  first  two  requirements  equations  reversed 
and  with  the  above  minimization  functional  replacing  the  maximiza- 
tion functional  of  Chapter  V.  This  has  no  finite  minimum,  i.e.,  X\,  x2, 
xs,  and  #5  can  be  increased  indefinitely  to  satisfy  the  equations  implicit 
in  the  above  three  inequalities,  and,  as  this  is  done,  xx  always  in- 
creases twice  as  much  as  does  x2.  Consequently,  —  Xi-\-x2  approaches 
—  00. 
The  dual  of  this  problem  is: 

2yi  —    y2  +  y%  <  —  1 
-  y\  +  2y2  +  yz  <  1 
Maximize  —  2yi  —  2y2  +  5y3 

There  is  no  solution  to  this  dual — finite,  or  otherwise. 

Now  suppose  we  combine  this  problem  and  its  dual  into  a  single 
game  problem  to  get  a  skew-symmetric  matrix,  where  JFi  =  #iZ, 
W2=x2z,  W3  =  yiZ,  Wi=y2z,  W6=yzZ,  W6  =  z,  and 

6 

Wi  >  0: 

0W!  +  0W2  +  2Wz  -  lWt  +  1W6  +  1W6  <  0 
OJFi  +  0W2  -  lWz  +  2W,  +  ITF5  -  1W6  <  0 

-  2Wi  +  1W2  +  OWz  +  0W*  +  0W5  -  2WG  <  0 
IWi  -  2W2  +  0W3  +  0W4  +  0W&  -  2W&  <  0 

-  lPFi  -  1W2  +  OWz  +  OW4  +  0W5  +  5Ws  <  0 

-  1WX  +  \W2  +  2Wz  +  2JF4  -  5TF5  +  0TF6  <  0 

Although  the  original  minimization  problem  has  no  finite  minimum 
and  the  dual  has  no  feasible  solution,  since  a  game  always  has  a  solu- 
tion, the  above  combined  game  problem  has  a  solution.  In  fact,  we 
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can  solve  it  as  a  linear  programming  problem  by  adding  the  specifica- 
tion that 

2  w,  =  i, 

by  adding  an  additional  variable  to  each  of  the  above  inequalities, 
then  subtracting  the  first  (second,  etc.)  equation  from  the  last  equa- 
tion, and  minimizing  the  last  above  inequality  (after  first  turning  it 
into  an  equation) : 

lTFi  +  1W2  +  lWi  +  lWt  +  lWs  +  1W6  =1 

-  lWi  +  1W2  +  0WS  +  SW4  -  6W*  -  1W,  -  1TF7  +  \Wt%  =  0 

-  lPPi  +  1W2  +  3W*  +  OW*  -  6W&  +  lWe  -  1W8  +  1WU  =  0 
lPPi  +  0W2  +  2TF3  +'  2TF4  -  5TF5  +  2JF6  -  1W9  +  ITF12  =  0 

-  2PTi  +  3TT2  +  2W*  +  2^4  -  5W&  +  2W6  -  1W10  +  !Wn  =  0 
OTFi  +  2W2  +  2TF3  +  2W*  -  5W,  -  5W6  -  tWu  +  IWu  =  0 

Minimize  -  lWi  +  1W2  +  2WZ  +  2TF4  -  5W,  +  lPTu 

An  optimum  solution  to  this  skew-symmetric  game  problem  finally 
emerges  as: 


1 

"wn 

ri/21 

1 

w2 

1/2 

2 

w, 

0 

0 

w9 

1/2 

0 

W10 

1/2 

0 

LWul 

_  1  _ 

Zoo  : 
0 

2/6 

8/6 

-  4/6 

-  3 

2/6 

38/6J 

Z06  =  2/6 


TF6- 


2 
■   -  3/6 
15/6 
-  1 

-  27/6 
27/6 
1 

203  =    1 

0 

1/6- 

1/6 

-  2/6 

-  3/6 
-1/6 

L-  2/6 J 
Z07  =  4/6 


W*- 


W: 


-  5 
■      21/6 

-  15/6 

0 
51/6 
45/6 

0 

Z05  =    1 

0 

2/6 

-4/6 

2/6 

1 
-  2 

-  4/6. 
Z08  =  2/6 


Wi 


Wt 


1 

"-  3/6 
3/6 
0 
-  9/6 

7/6 
0  . 

Z0,12   —   0 


JFi 
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This  means  that  B  should  play  only  strategies  No.  1  and  No.  2,  and 
these  should  be  given  equal  weights  of  1/2.  This  is  an  optimum 
strategy,  since  the  bottom  row  of  z's  tells  us  we  have  reached  an 
optimum  solution. 

This  provides  us  with  an  optimal  strategy  for  B  (and,  of  course, 
for  ^4).  But  this  is  clearly  no  solution  to  the  original  linear  program- 
ming problem,  since  we  have  W$  =  z~0.  This  does  not  necessarily 
mean  that  there  is  no  finite  minimum  for  the  functional,  for  there 
might  be  another  optimal  solution  to  this  game  with  z>0.  It  does, 
however,  mean  that,  even  if  the  original  linear  programming  problem 
and  its  dual  do  have  optimal  x's  and  y's  (i.e.,  x's  and  y's  which 
minimize  and  maximize  their  respective  Junctionals) ,  this  set  of  opti- 
mal x's  or  y's  is  unbounded — for  z  will  never  equal  zero,  if  both  the  opti- 
mal x's  and  y's  are  finite.1  In  this  simple  case,  however,  it  is  easily 
seen  that  there  is  no  finite  minimum  for  the  original  linear  program- 
ming problem  and  no  feasible  solution  for  its  dual,  so  there  is  no 
optimal  strategy  for  the  game  which  would  result  in  a  z>0. 

Unbounded  set  of  optimal  x's  or  y's.  Now  consider  a  simple  linear 
programming  problem  that  leads  to  a  game  in  which  optimal  strate- 
gies exist  with  both  2=0  and  z>0.2  From  the  preceding  paragraph,  it 
should  follow  that  this  is  indeed  a  problem  having  finite  optimums  for 
the  Junctionals  (for  it  is  possible  to  find  a  z>0),  but  having  the  set  of 
optimum  x's  or  y's  unbounded  (for  it  is  possible  to  find  a  2  =  0): 

y\  —  yi  <  —  1 

Maximize  y\  —  yi 
The  dual  of  this  problem  is: 

xi  >  1 
-  xt  >  -  1 

Minimize  —  Xi 

First  looking  at  the  minimization  dual,  it  is  clear  that  necessarily 
#i=l,  if  both  requirements  inequalities  are  to  be  satisfied.  For  it  is 
otherwise  impossible,  at  the  same  time,  to  have  #i>l  and  —  Xi>  —  1. 

1  Cf.  Luce  and  Raiffa,  Games  and  Decisions  (New  York:  John  Wiley  and  Sons,  1957), 
pp.  420-423  for  a  rigorous  mathematical  proof.  See  also  Dorfman,  Samuelson,  and  Solow, 
Linear  Programming  and  Economic  Analysis  (New  York:  McGraw-Hill  Book  Company, 
Inc.,  1958),  pp.  453-462. 

■  This  problem  is  taken  from  Dorfman,  Samuelson,  and  Solow,  op.  cit.  A  somewhat 
similar  problem  is  also  cited  in  S.  Vajda,  The  Theory  of  Games  and  Linear  Programming 
(London:  Methuen  and  Co.  Ltd.,  1956),  p.  77. 
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So  there  is  a  finite  minimum  (—1),  and  the  "set"  of  x's  is  bounded 
(#i=l).  It  is  also  clear,  in  the  maximization  problem,  that  all  pairs 
of  values  for  yi  and  y2  in  which  y2=;yi+ 1  constitute  optimal  solutions 
to  the  maximization  problem — subject,  of  course,  to  the  usual  non- 
negative-variables  restriction.  In  brief,  there  is  an  optimal  value  for 
the  maximization  problem  and  its  dual — namely,  Z  =  yi— y2=f  =  —'% 
=  —  1— but  that  same  optimal  value  can  result  from  an  infinite  num- 
ber of  pairs  of  values  for  yi  and  y2. 

Now  that  we  have  reasoned  out  the  answer  to  this  linear  program- 
ming problem,  consider  what  happens  when  we  combine  it  and  its 
dual  into  a  game.  Moving  the  right-side  coefficients  of  the  three  re- 
quirements inequalities  to  the  left  side,  then  changing  all  signs  of  the 
two  minimization  inequalities  (to  change  these  inequalities  from 
>0  to  <0),  subtracting  the  maximization  functional  from  the  mini- 
mization functional,  and  multiplying  all  terms  of  these  four  inequali- 
ties by  z,  we  have : 

OTFi  +  1W2  -  IW3  +  ITF4  <  0 

-  lWi  +  0W2  +  OWz  +  ITF4  <  0 
lWi  +  0W2  +  0WZ  -  \Wi  <  0 

-  \Wx  -  1W2  +  1W*  +  01^4  <  0 

where  Wi  =  XiZ,  W2  =  yiz,  W3  =  y2z,  Wi=z,  and 

4 
Wj  >  0. 

This  game  problem,  too,  we  may  solve  by  turning  it  back  into  a 
new  linear  programming  problem.  Following  the  now  familiar  pro- 
cedure, we  add  one  variable  to  each  of  the  above  four  inequalities, 
make  the  last  of  these  four  resulting  equations  our  new  minimization 
functional,  subtract  the  first  (second,  etc.)  equation  from  the  last, 
and  place  at  the  top  the  additional  requirements  equation  of 

£  wj  =  1.    . 

i=i 

This  results  in: 

lWi  +  11^2  +  lWz  +lWi  =1 

-  lWi  -  2W2  +  2W3  -  \W,  -  1W5  +  lWs  =  0 
OT^i  -  1W2  +  1W%  -  1WA  -  1W6  +  1W8  =  0 
Minimize  -  lWi  -  1W2  +  1WZ  +  IWs  =  f  -  Z  =  0  (optimally) 
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If  we  solve  this  system  for  Wi,  W2,  and  W3,  and  We,  we  get: 

0  0 


Wi 


-  1 

"Wi" 

- 

0  ' 

•-  r 

"  — 

1/3-1 

-  1 

1 

w2 

Wz 

= 

1/2 
1/2 

— 

3/2 
1/2 

Wi- 

1/2 
-1/6 

0 

-W6_ 

0  . 

.    0  _ 

.-  2/3. 

ZOO   =   0        Z04   =   0                   005   =    1/3 

0                          1 

"      2/3" 

'-  1/3" 

— 

-1/2 
-1/6 

W7- 

0 

1/3 

W» 

-      1/3. 

.-  2/3_ 

Z07 

=    1/ 

3 

Z08  = 

1/3 

The  z's  at  the  bottom  tell  us  that  we  have  reached  an  optimum 
strategy  for  B  for  which  the  value  of  the  game  is  zero,  and  we  note 
that  that  strategy  is  for  B  to  play  strategies  No.  2  and  No.  3  with 
equal  frequency.  We  also  note  that,  with  TF4  =  0,  we  do  not  have  a 
solution  to  the  original  linear  programming  problem. 

As  we  already  know,  however,  although  an  infinite  number  of  pairs 
of  values  for  yx  and  y2  exist  such  that  y2  =  yi+l,  the  maximization 
functional  (and  hence  the  dual  of  its  problem)  does  have  an  optimal 
feasible  solution;  so  there  must  exist  a  solution  in  which  z>0.  Indeed, 
this  is  also  revealed  by  the  above  bottom  row  of  z's.  Since  the  dual  of 
a  skew-symmetric  matrix  is  the  dual  of  itself,  we  can  conclude  that, 
for  the  dual,  z05=zBo  =  Zio=l/3,  Zo7  =  Z7o=z3o=l/3,  and  z08=z8o  =  Z4o 
=  1/3.  But  z4o  =  JF4=z.  Therefore,  an  additional  optimal  solution  to 
the  game  must  be  Wx=  1/3,  W2=0,  Ws=  1/3,  and  W,=  1/3. 

In  fact,  if  we  choose  the  hard  way  to  verify  this,  we  find  that : 


W* 


-  1 

0 

1 

"wh 

ri/3i 

■      2/3" 

o  - 

1 

0 

W* 

w* 
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1/3 

1/3 
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-1/3 

2/3 

W2- 

-1/2 
1/2 
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-W5_ 

_  0  _ 

0  _ 

_-  3/2_ 

Zoo  =  0 


Z02 


Z06  =  1/2 
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Wt 


r   i/3i 

[-  1/3-1 

-1/6 
-1/6 

W7- 

2/3 
-1/3 

L-  1/2  j 

1  . 

zo7  =  1/2 

Z08  =  0 

Dividing  Wi,  W2,  W3  by  Wt  =  z,  we  thus  have  an  optimal  solution  to 
the  linear  programming  problem  and  its  dual  of  x±=  1,  Vi  =  0,  y2  —  1. 
Now  any  positive  weighted  average  of  the  above  two  optimal  game 
strategies  for  this  game  will  also  be  an  optimal  strategy.  Therefore, 
there  is  an  infinite  number  of  optimal  game  strategies  and  there  is  an 
infinite  number  of  pairs  of  values  for  yx  and  y2  which  will  satisfy  the 
maximization  functional.  This  follows  because,  in  general,  if  we  define 
our  weights  as  (1— a)  and  a  for  our  two  strategies,  and  if  we  let 

W/  [specifically,  W/  =  (0,  1/2,  1/2,  0)1 

and 

W/'  [specifically,  W/f  =  (1/3,  0,  1/3,  1/3)1 

stand  for  the  above  two  strategies,  for  the  other  infinite  number  of 
optimal  game  strategies  we  should  have: 

(PTi,  W2,  Wh  Wi)  =   [(1  -  a)WV  +  aWx",  (1  -  a)W%'  +  aW2" ', 

(1  -  a)Wi'  +  olWz",  (1  -  a)Wi'  +  aW^} 
1  -a     3  - 


(a      1  —  a     3  —  a      a\ 
3  '       2  6      '    3  / ' 


where  0<a<l. 

For  all  solutions  to  our  specific  linear  programming  problem,  then, 
we  should  have: 


/Wt 

(xi,yi,y2)  =  (  — 

\Wi 


w2 

W* 
3  -3a 


W 
~W. 
3  - 


2a 


a\  =  /a_    3_ 
J       \  3  'a 


3      1  -a    3      3  - 
~2~'~a~'  ~6 


a    3\ 
a/ 


LINEAR  PROGRAMMING  PROBLEMS  125 

where  0<a<l.  Clearly,  then,  whatever  value  we  choose  for  a  (be- 
tween 0  and  1),  it  will  always  be  true  that  each  of  the  infinite  number 
of  mixed  strategies  will  result  in  Xi=  1.  Similarly,  although  the  infinite 
number  of  different  values  for  a  will  result  in  an  infinite  number  of 
different  values  for  yx  and  y2,  in  all  cases  it  will  be  true  that  y±  —  y2 
=  -1,  for 

3  —  3a       3  —  a        —2a 
2a  2a  2a 


CHAPTER  X 

Epilogue:  Linear  Programming,  Game  Theory, 
and  Economics 

The  principal  objective  of  this  book  has  been  to  impart  an  under- 
standing of  the  largely  mathematical  rationale  underlying  the  tech- 
niques of  linear  programming  and  game  theory.  Indeed,  Chapters 
II-IX  inclusive  revolved  almost  entirely  around  that  objective. 
Nevertheless,  to  put  the  rather  abstract  developments  of  those  chap- 
ters in  proper  perspective,  a  concrete  orientation  problem  was  out- 
lined in  the  latter  part  of  Chapter  I,  and  certain  aspects  of  this  same 
problem  were  also  considered  in  Chapters  II,  VI,  VIII,  and  IX. 

It  was  further  stated  in  Chapter  I  that  the  academician  tends  to 
view  linear  programming  and  game  theory  techniques  as  analytical 
tools,  while  the  businessman  tends  to  view  these  techniques  as  de- 
cision-making aids.  Now  in  looking  at  our  orientation  problem,  our 
view  has  been,  at  least  implicitly,  that  of  business  management — for 
the  focus  of  our  attention  has  usually  been  upon  discovering  an  opti- 
mal solution  to  the  problem.  Neither  explicitly  nor  implicitly  have  we 
said  anything  about  the  (academic)  economist's  viewpoint. 

An  optimal  solution  to  a  problem  is  not  the  thing  upon  which  the 
economic  theorist  primarily  tends  to  focus  his  attention.  Rather,  the 
economist  will  generally  focus  his  attention  more  upon  the  character- 
istics of  that  optimal  solution,  once  such  a  solution  has  been  found. 
For  this  reason,  it  is  only  appropriate  to  conclude  this  book  with  a 
brief  consideration  of  linear  programming  and  game  theory  tech- 
niques as  analytical  tools  of  the  economist. 

linear  programming  and  economics 

Certainly  the  most  complete  and  outstanding  work  on  the  rela- 
tionship between  linear  programming  and  economic  analysis  is  the 
substantial  volume  of  Dorfman,  Samuelson,  and  Solow.1  Perhaps  the 
most  enlightening  example  (for  our  purposes)  of  the  relationship  be- 
tween linear  programming  and  economic  analysis  considered  by 
these  authors  is  concerned  with  general-equilibrium  theory.2  This 
is  also  one  of  the  most  complicated  problems,  and  we  must  content 

1  Linear  Programming  and  Economic  Analysis  (New  York:  McGraw-Hill  Book  Com- 
pany, Inc.,  1958). 

2  Ibid.,  Chapter  13,  especially  pp.  351-375. 
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ourselves  with  a  cut  version  of  only  some  of  the  main  features.  Such  a 
version  is  no  substitute  for  the  full  treatment,  but  it  will  suffice  for 
our  purposes  and  it  should  also  encourage  the  economist  to  expose 
himself  to  the  full  treatment.3 

Walras-Cassel  system.  Consider  a  Walras-Cassel  general-equilib- 
rium system  embracing  an  economy  with  m  resources  (or  factors  of 
production)  and  n  final  commodities.4  For  this  system,  we  adopt  the 
following  symbolic  terminology: 

rz=the  amount  of  the  £*th  resource  supplied; 
tfj  =  the  amount  of  thejth  commodity  produced; 
aij=th.e  physical  amount  of  the  ith  resource  used  in  producing  one 
unit  of  the  7th  commodity. 
Note  that  each  ai3-  is  an  input  coefficient  of  the  Walras-Leontief  type. 

Under  this  symbolic  terminology,  then,  producers  of  the  first  com- 
modity Oi)  would  demand  chiXi  units  of  the  first  resource  (n),  and 
producers  of  the  nth.  commodity  (xn)  would  demand  alnxn  units  of 
this  same  first  resource.  Since  n  is  the  supply  of  the  first  resource,  if 
we  equate  demand  and  supply,  we  have : 

"  #11*1  +  #12*2  +    *    *    *   +  ainXn  =   ^1 

Since  similar  considerations  apply  for  each  resource, 

m 

ri, 

*=i 

we  have  m  equations: 

011*1    +  012*2    +    *    '    '    +  dlnXn     =   T\ 
#21*1    +  022*2    +    '    *    *    +  #2n*n     =   ^2 

(1)  

dmlXi  +  0m2*2  +•    *    *    *    +  CLmnXn  =   fm. 

Now  if  pj  is  the  price  of  the  ith  commodity  (xj)  and  v{  is  the  price 
of  the  services  of  the  Mi  resource  (r%),  we  can  say  that  the  market- 
demand  equations  for  the  n  commodities  are : 

Xi   =    Fi(ph   '   •   '  >  P*i  VU   '   '   '  J  O 

(2)  ••••.. 

Xn  =   Fniph    •    '    '   ,  pn'yVi,   '   '    '  ,  Vm) , 

3  For  the  convenience  of  such  people,  both  the  symbols  and  the  numerical  example 
cited  in  this  section  are  precisely  those  of  Dorfman,  Samuelson,  and  Solow. 

4  This  simplification  can  be  (and  ultimately  is)  amended  to  include  intermediate  goods 
by  Dorfman,  Samuelson,  and  Solow. 
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the  Vi  factor  prices  appearing  in  these  demand  functions  to  allow  for 
changes  in  demand  due  to  shifts  in  the  level  and  distribution  of  in- 
come. 

A  condition  of  long-run  competitive  equilibrium  states,  of  course, 
that  the  price  of  each  commodity  must  equal  its  unit  costs.  Moreover, 
with  intermediate  goods  washed  out,  unit  costs  necessarily  consist  of 
payments  for  resources.  Consequently,  each  unit  of  the  total  Xi  units 
of  the  first  commodity  requires  an  units  of  the  first  resource  (n),  a2i 
units  of  the  second  resource  (r2),  and  so  on  to  am\  units  of  the  wth 
resource  (rm).  For  the  first  commodity,  then,  we  have,  in  equilibrium, 
that: 

011  »1  +  021%  +  •  •  •  +  amivm  =  pi. 

Since  there  are  n  commodities,  we  thus  have  a  system  of  n  equations : 

flufli  +  021^2  +  •  •  •  +  am\vm  =  pi 

012%    +  022%    +    *    *    '    +  0m2^m    =    p2 


(3) 


ainVl  +  02nV2  +    *    *    *    +  OmnOm   =   pn. 


Thus  the  matrix  of  the  a^  coefficients  for  equations  (3)  is  the  trans- 
pose of  the  matrix  of  coefficients  for  equations  (1),  which  gives  some 
hint  of  what  is  coming. 

Just  as  one  can  derive  the  zero-degree  homogeneous  demand  func- 
tions (2)  for  commodities  as  functions  of  the  p3-  and  viy  one  can  also 
derive  zero-degree  homogeneous  supply  functions  for  resources  as 
functions  of  the  p3  and  z>»-.  In  our  case,  however,  we  shall  simply  take 
the  factor  supplies  (r,-)  as  given.5 

Looking  at  our  system  of  the  three  sets  of  equations  (1),  (2),  and 
(3),  we  must  ask  ourselves  whether  this  system  necessarily  has  a 
solution  which  makes  economic  sense.  Equations  (1)  consist  of  m 
equations  in  n  unknowns.  If  m>n,  these  equations  will  certainly 
have  no  solution,  unless  the  ai3-  coefficients  and  the  resource  supplies 
stand  in  a  very  special  relationship  to  each  other,  and  there  is  no 
reason  to  expect  such  a  happy  circumstance. 

Even  if  m  =  n,6  there  is  still  no  assurance  that  our  system  has  an 

6  Here,  too,  Dorfman,  Samuelson,  and  Solow  ultimately  expand  their  system  to  include 
supply  functions  for  resources. 

6  This  was  the  case  in  the  Walrasian  system,  i.e.,  Walras  "disposed"  of  the  solution- 
existence  problem  by  showing  that  the  number  of  equations  was  equal  to  the  number  of 
unknowns  in  his  system. 
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economically  meaningful  solution.  To  see  this,  consider  a  system  with 
two  final  goods,  two  resources,  input  coefficients  of  an=l,  #12  =  2, 
#2i  =  3,  022  =  4,  and  given  factor  supplies  of  ri=2,  r2  =  20.  This  turns 
the  general  equations  (1)  into  the  specific  equations  of: 

Xi  +  2^2  =  2 

(1)' 

3xi  +  4*2  =  20 

Suppose,  further,  that  the  elasticity  of  demand  for  both  of  our 
final  goods  is  (independent  of  factor  prices)  unity,  so  that  piXx  =  S 
and  piXi— 10.  Then  the  specific  counterpart  of  the  general  equations 
(2)  is: 

8 

(2)'  *!=- 

Pi 

10 

Xi  =  — 

P2 

And,  of  course,  the  specific  counterpart  of  the  general  equations  (3)  is: 
(3)'  vi  +  3fl2  =  pi 

2v\  +  4%  =  pi 

At  this  point,  we  really  need  not  concern  ourselves  with  (2)'  and 
(3)'.  Equations  (1)'  immediately  tell  us  that  there  is  no  solution  to 
this  system  which  makes  economic  sense.  Our  first  commodity  uses 
the  two  resources  in  a  ratio  of  1 : 3  and  the  second  commodity  uses 
them  in  a  ratio  of  2 : 4.  Since  the  supply  of  the  two  factors  stands  in  a 
ratio  of  1:10,  however,  how  can  r2(  =  20)  be  fully  employed? 

Indeed,  if  we  solve  equations  (1)',  we  immediately  encounter  pre- 
cisely the  same  sort  of  snag  as  we  struck  in  our  first  solution  to  the 
blending  problem  equations  of  Chapter  I:  namely,  a  negative  vari- 
able. For  the  solution  to  equations  (1)'  results  in  xi=  16,  x2  =  —  7,  and 
this  has  no  real  economic  meaning. 

If  the  economic  system  of  equations  (1),  (2),  and  (3)  does  not  rep- 
resent a  system  to  which  a  solution  necessarily  exists,  can  that  system 
be  amended  in  such  a  way  as  to  assure  us  that  a  meaningful  solution 
always  exists?  The  answer  to  this  question  is  an  affirmative  one,  and 
the  amending  process  leads  us  into  the  equivalent  of  a  linear  pro- 
gramming problem  and  its  dual. 

The  amended  system.  One  of  the  jobs  of  the  general-equilibrium 
system  is  to  decide,  in  terms  of  the  given  data,  which  resources  shall 
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be  free  and  which  shall  have  a  positive  price.  Consequently,  the  list  of 
resources 


G) 


of  the  Walras-Cassel  model  should  be  all-inclusive.  But  equations  (1) 

say,  in  effect,  that  there  are  no  free  resources,  i.e.,  that  all  resources 

are  fully  employed.  Diagrammatically  speaking,  however,  there  is  no 

reason  why  the  (assumed-to-be)  perfectly  inelastic  supply  curve  (a 

line  perpendicular  to  the  x-axis)  of  say  rk  should  not  hit  the  #-axis  to 

the  right  of  the  point  at  which  the  demand  curve  for  rk  hits  the  rr-axis. 

Such  a  situation  would  mean  a  zero  price  for  rk  and  something  less 

than  full  employment  of  that  resource. 

An  obvious  way  to  incorporate  this  possibility  into  equations  (1)  is 

to  supplant  the  =  signs  of  (1)  with  <  signs.  Our  first  set  of  equations 

then  becomes: 

anXi  +  anx2  +  •.••  +  ainXn  <  n 

021#1    +  #22#2    +    '    '    '    +  (hnXn     <   H 

(la)  

dm\X\  +   am2X2  +    *    *    *    +  CLmnXn   <   fm, 

and  we  understand  that  the  economic  meaning  is  that,  if  the  strict 
inequality  holds  in  any  row  of  (la),  the  resource  of  that  row  (say  r2) 
is  less  than  fully  employed  and  r2's  price,  v2,  is  zero. 

A  somewhat  analogous  adjustment  is  also  indicated  for  equations 
(3),  namely,  the  unit-costs-equal-price  equations.  The  rationale  be- 
hind these  equalities  in  equilibrium  is,  of  course,  that:  (a)  if  price 
exceeds  unit  costs,  both  factor  prices  and  output  will  rise,  thus  lower- 
ing price  and  increasing  costs;  and  (b)  if  unit  costs  exceed  price,  the 
reverse  process  will  take  place.  There  is,  however,  a  limit  to  the 
reverse  process,  since  output  cannot  fall  below  zero.  Consequently,  it 
is  perfectly  feasible  for  unit  costs  to  exceed  price  at  zero  output  (in 
the  words  of  Dorfman,  Samuelson,  and  Solow,  "It  is  no  accident  that 
silk  diapers  are  so  rare"). 

An  obvious  way  to  incorporate  this  phenomenon  into  equations  (3) 
is  to  supplant  the  =  signs  of  (3)  with  >  signs.  The  third  set  of  equa- 
tions then  becomes: 

duVl    +  fl2ll>2    +    '    '    *    +  dmlVm    >   pi 
duVl    +  022V2    +    •    *    *    +  dmZVm    >   p2 


(3a)  

dlnVl  +  d2nV2  +    *    *    *    +  dmnVm   >   pn, 
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and  we  understand  that  the  economic  meaning  is  that,  if  the  strict 
inequality  holds  in  any  row  of  (3a),  the  output  of  the  commodity  rep- 
presented  by  that  row  (say  x2  for  the  second  row)  is  zero. 

Now  let  us  return  to  the  specific  sets  of  equations  (1)',  (2)',  and 
(3)',  amending  (1)'  and  (3)'  to  get: 

la)'  xi  +  2x2  <  2 

3a*  +  4x2  <  20 

(2)'  *!=- 

Pi 

10 

x2  =  — 

P2 

(3a)'  vi  -f  3v2  >  pi 

2v!  -f  4z>2  >  pi 

Suspecting  that  3xi+4x2<20  (i.e.,  a  strict  inequality  holds)  and  that 
v2=0,  since  we  then  have  from  (3a)'  that  vx  =  px  and  2z/i  =  p2,  it  follows 
that  p2  =  2p!. 

We  can  now  substitute  2px  for  p2  in  the  second  equation  of  (2')  to 
get: 

(2)"  fr  =  - 

Xi 

5 

/>!  =  — 

#2 

From  this  we  deduce  that,  since 

8        5 

—  =  —  >  Sxi  —  8*2  =  0. 
Xi        x2 

If  we  combine  this  last  equation  with  the  first  equation  of  (la)',  and 
solve  these,  we  get  ^  =  8/9,  x2  =  5/9. 

From  (2)'  it  then  follows  that  pi  =  9,  p2=lS.  And  from  both  equa- 
tions of  (3a)'  it  follows  that  v±  =  9.  Moreover,  the  first  resource  is  fully 
employed,  and  from  the  left  side  of  the  second  inequation  of  (la)r  we 
can  see  that  3X8/9+4X5/9  =  44/9,  which  is  the  amount  of  the  sec- 
ond resource  used,  leaving  136/9  of  r2  unemployed. 

This  is  the  sensible  and  quicker  way  to  solve  this  problem.  We 
could,  however,  have  directly  unlimbered  our  linear  programming 
techniques  on  this  problem.  For,  if  we  examine  (la)  and  (3a),  it  looks 
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suspiciously  as  though  we  were  looking  at  .the  constraints  of  dual 
linear  programming  problems.  Indeed,  we  might  even  specify  the 
functional  for  (la)  as  Maximize  piXi+  •  •  •  +pnxn  (=  value  of  out- 
put), and  for  (3a)  as  Minimize  r&i+  •  •  •  -{-rmvm  (  =  total  factor  in- 
come), in  both  cases  for  non-negative  variables. 

At  this  point,  we  should  note  two  ways  in  which  this  problem  is 
different  from  any  of  the  problems  we  have  solved  in  the  preceding 
chapters.  In  the  first  place,  while  we  know  that  none  of  the  an,  ri}  vi} 
pi,  or  Xj  can  be  negative,  inequations  (la)  and  (3a)  are  otherwise  in 
a  completely  general  form,  i.e.,  we  have  no  specific  values  for  the  co- 
efficients and  the  variables.  Since  we  also  know  (from  Chapter  V) 
that  not  every  linear  programming  problem  necessarily  has  a  feasible 
solution,  how  do  we  know  that  this  particular  generalized  one  always 
has?  Secondly,  inequations  (la)  and  (2a)  have,  instead  of  the  con- 
ventional two  unknowns,  three  unknowns:  namely,  vi}  p3;  and  Xj  (re- 
member, we  took  the  r*  as  given) . 

Turning  to  the  first  of  these  two  points,  the  two  linear  program- 
ming problems  do  necessarily  have  feasible  solutions — thanks  to  the 
fact  that  there  can  be  neither  negative  variables  nor  negative  ai3-  co- 
efficients. In  other  words,  no  matter  what  the  values  of  the  right 
sides  of  inequations  (la)  and  (3a),  we  can  always  find  values  small 
enough  for  the  x3  and  large  enough  for  the  vt  to  make  both  sets  of 
inequations  valid.  Knowing  that  solutions  to  the  linear  programming 
problems  do  exist,  we  also  know  (from  the  fundamental  duality 
theorem)  that 

n  m 

2j  pjXj  and  V.  nvi 

are  equal:  namely,  that  the  maximization  functional  (total  expendi- 
ture) equals  the  minimization  functional  (total  income),  provided  an 
equilibrium  solution  to  the  general  equilibrium  problem  exists  (which 
we  have  yet  to  prove)  which  is  also  a  solution  to  the  linear  program- 
ming problems.  Consequently,  although  we  can  so  far  be  sure  of  little 
else,  it  should  now  seem  clear  that  every  competitive  equilibrium 
system  implicitly  contains  a  maximization-of-value-output  problem 
and  a  minimization-of-factor-returns  problem. 

While  we  know  that  the  dual  linear  programming  problems  have 
solutions,  we  do  not  yet  know  that  an  equilibrium  solution  exists  to 
the  general  equilibrium  problem.  The  reason  for  our  ignorance  on  this 
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point  is  associated  with  the  above-mentioned  fact  that  the  linear  pro- 
gramming problems  involve  the  three  unknowns  of  n  p's,  n  x's,  and 
m  v's.  The  n  p's  are  on  the  right  side  of  inequations  (3a),  and  we 
were  able  to  deduce  that  solutions  existed  to  the  linear  programming 
problems,  partially  because  any  set  of  non-negative  p's  could  result 
in  a  solution  to  the  linear  programming  problems. 

It  is  not  true,  however,  that  any  set  of  non-negative  p's  will  assure 
the  existence  of  an  equilibrium  solution  to  the  general  equilibrium 
system.  The  linear  programming  problem,  viewed  purely  as  such,  is 
concerned  only  with  inequations  (la)  and  (3a).  The  general  equilib- 
rium system,  however,  also  includes  equations  (2).  We  can  choose 
any  set  of  p's  and  solve  the  linear  programming  problems  to  get  the 
acceptable  sets  of  x's  and  v's  for  the  linear  programming  problems. 
But  there  is  clearly  no  assurance  that  these  sets  of  p's,  x's  and  v's  will 
also  satisfy  equations  (2).  The  basic  question  is,  then,  whether  it  is  a 
certainty  that  there  is  at  least  one  set  of  p's  which  will  yield  sets  of 
x's  and  v's  that  will  also  satisfy  equations  (2). 

For  our  purposes,  it  is  perhaps  necessary  to  go  no  further  than  to 
accept  on  faith  the  fact  that  Kakutani's  fixed-point  theorem  assures 
us  that  the  answer  to  this  last  question  is  in  the  affirmative.7  It  can 
then  be  shown  that  there  does  indeed  exist  an  equilibrium  solution  to 
the  general  equilibrium  system,  and  this  solution  is  also  unique  in  p 
and  x,  if  we  accept  the  axiom  of  revealed  preference. 

From  this  discussion  of  the  amended  system,  then,  we  have 
garnered  two  main  points  of  information:  (1)  every  competitive 
equilibrium  system  implicitly  contains  a  maximization-of-value-out- 
put  problem  and  a  minimization-of-f actor-returns  problem;  (2)  not 
only  do  solutions  to  the  linear  programming  problems  exist,  but  there 
also  exists  a  unique  solution  to  the  general  equilibrium  system.  It  is  a 
fair  question,  from  the  economist's  viewpoint,  whether  proving  the 
mere  existence  of  an  equilibrium  solution  to  the  general  equilibrium 
system  is  really  worth  all  this  bother. 

Importance  of  existence  theorems.  As  one  well-known  economist 
has  accurately  said,  "  .  .  .  the  existence  theorems  ...  are  mainly  re- 
assuring. It  is  nice  to  know  that  someone  somewhere  has  shown  that 
our  model  does  indeed  have  a  solution."8  But  if  this  is  an  accurate 

7  Cf.  Dorfman,  Samuelson,  and  Solow,  pp.  371-374. 

8  W.  J.  Baumol,  "Activity  Analysis  in  One  Lesson,"  American  Economic  Review,  De- 
cember, 1958,  p.  872.  It  might  be  added  that  this  is  a  good  article,  even  if  one  cannot 
really  master  activity  analysis  in  one  lesson. 
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statement  in  the  literal  sense,  the  flavor  it  seems  to  carry  appears  to 
be  somewhat  less  accurate.  There  is  something  more  positive  than  this 
to  be  said  for  proof  of  the  existence  of  an  equilibrium  solution  to  the 
general  equilibrium  system,9  and  Dorfman,  Samuelson,  and  Solow 
have  said  it  about  as  well  as  anyone  could  ask.10 

There  can  be  no  doubt  that  whatever  the  true  model  of  the  real  eco- 
nomic world  may  look  like,  a  solution  to  it  would  have  to  exist,  since 
the  real  economic  world  does  function.  But  it  is  less  than  certain  that 
this  real-economic-world  solution  is  one  involving  a  perfectly  com- 
petitive equilibrium.  In  any  event,  we  cannot  be  sure  that  the  prop- 
erties of  our  abstract  model  are  an  accurate  portrayal  of  the  real 
world. 

Now  the  purpose  of  the  economist's  abstract  model  is  to  enhance 
his  study  of  the  real  economic  world.  For  this  reason,  it  is  important 
to  know  whether  the  collection  of  supply-demand  relations  of  the 
model  gives  an  accurate  portrayal  of  what  is  important  in  the  real 
economic  world.  Proof  of  the  existence  of  a  solution  to  the  abstract 
model  is  not  a  sufficient  condition  for  guaranteeing  that  such  is  the 
case,  but  it  is  a  necessary  condition.  Thus,  for  example,  while  we  can- 
not know  that  the  amended  system  is  an  accurate  portrayal  of  the 
real  economic  world,  at  least  we  do  know  that  it  satisfies  one  neces- 
sary condition  for  such  a  portrayal  that  the  initial  Walras-Cassel 
model  does  not  satisfy.  This  would  seem  to  be  more  than  a  minor 
contribution,  and  the  amended  system  does  make  more  economic 
sense. 

What  sort  of  conclusion  should  we  draw,  then,  about  the  impor- 
tance of  linear  programming  techniques  to  economic  analysis?  There 
can  scarcely  be  any  question  about  the  value  of  these  techniques  to 
applied  problem  solving.  Hence,  there  can  be  little  doubt  about  their 
importance  to  either  business  management  as  a  decision-making  aid 
or  to  the  economist  concerned  with  certain  types  of  specific  questions. 

9  While  analogies  can  be  misleading,  analogies  to  this  particular  case  of  proving  the 
existence  of  a  solution  to  a  problem  are  to  be  found  in  the  world  of  pure  mathematics. 
Mathematicians  spent  a  lot  of  time,  for  example,  during  the  seventeenth  and  eighteenth 
centuries,  trying  to  find  general  equations  for  solving  equations  of  the  fifth  degree  and 
higher  by  radicals.  But  not  until  1799  did  Gauss  develop  the  first  complete  proof  that  such 
equations  could,  in  fact,  be  solved  at  all.  And  it  required  a  few  more  years  for  Abel  and 
Ruffini  (independently)  to  conceive  the  revolutionary  idea  of  proving  the  impossibility  of 
the  approach  by  radicals.  It  is  probably  conservative  to  say  that  most  mathematicians  re- 
gard these  as  worthwhile  contributions. 

10  Ibid.,  pp.  350-351. 
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The  importance  of  these  techniques,  to  the  economist  concerned  with 
such  general  problems  as  the  equilibrium  one  we  have  considered, 
may  be  currently  more  debatable,  at  least  in  the  sense  that  we  cannot 
yet  be  certain  how  vital  the  role  so  far  played  by  these  techniques  will 
ultimately  prove  to  have  been ;  but  if  this  is  so,  it  is  equally  true  that 
we  cannot  yet  lightly  conclude  that  that  role  will  not  prove  to  have 
been  a  crucial  one. 

GAME  THEORY  AND  ECONOMIC  ANALYSIS 

There  is  little  disagreement  as  to  the  importance  of  game  theory 
techniques  to  economic  analysis.  These  techniques  have  some  in- 
direct value  in  those  cases  where  there  is  something  to  be  gained  by 
turning  a  linear  programming  problem  into  a  game  for  solution  pur- 
poses. Beyond  this  there  is,  at  least  currently,  not  too  much  to  be 
said  for  game  theory  techniques  as  an  economic  tool,  and  for  fairly 
obvious  reasons. 

The  theory  outlined  in  Chapter  VII,  and  the  games  solved  in 
Chapters  VIII  and  IX,  were  zero-sum  (i.e.,  ^4's  gains  were  equal  to 
B's  losses)  two-person  (namely,  just  A  and  B)  games.  Unfortunately, 
few  problems  in  economics  take  the  form  of  zero-sum  two-person 
games.  Rather,  such  problems  tend  to  run  to  raw-zero-sum  two-per- 
son games — the  classic  example  being  a  bargaining  "game"  between 
trade  union  and  management,  in  which  both  players  may  conceivably 
either  gain  or  lose;  or  such  problems  tend  to  run  to  more-than-two- 
person  games— oligopoly  being  an  obvious  case.  But  the  current 
state  of  game  theory  in  these  more  complicated  games  is  far  from 
satisfactory. 

For  essentially  the  same  reasons,  it  may  also  be  said  that  game 
theory  techniques  do  not  have  a  great  deal  more  to  contribute  to 
business-management  decisions  than  they  have  to  economic  analysis. 
One  possible  (and  perhaps  potentially  important)  exception  to  this  is 
such  unconventional  "games"  as  business  management  must  play 
with  "Nature"  as  its  opponent,  for  Nature  will  not  behave  like  the 
typical  malevolent  opponent.11  Given  such  a  game  matrix,  there  will 
frequently  be  probability  coefficients  for  Nature's  strategies  which 
make  it  a  matter  of  indifference  to  management  which  one  of  its  own 
strategies  it  follows.  If  management  is  in  a  position  to  make  an  in- 

11  E.  G.  Bennion,  "Capital  Budgeting  and  Game  Theory,"  Harvard  Business  Review, 
November-December,  1956. 
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telligent  estimate  of  what  the  true  probabilities  for  each  of  Nature's 
strategies  are,  then  a  comparison  of  these  estimated  true  probabilities 
to  the  indifference  probabilities  will  reveal  an  estimate  of  both  man- 
agement's best  strategy  and  the  degree  of  that  strategy's  "bestness." 

CONCLUSION 

Does  the  preceding  assessment  mean  that  linear  programming  and 
game  theory  techniques  are  not  important  enough  to  economics  to 
warrant  an  economist's  making  the  considerable  investment  in  time 
required  for  a  useful  understanding  of  these  techniques?  It  is  cer- 
tainly true  that  "Programming  is  mathematics,  not  economics."12 
But  this  is,  of  course,  no  argument  for  ignoring  programming  and 
game  theory  techniques.  Programming  is  no  more  business  than  it  is 
economics,  but  it  does  have  much  to  offer  business.  The  calculus  is 
also  mathematics,  not  economics — but  the  calculus  is  an  indisputably 
powerful  tool  for  the  economic  theorist.  The  real  question  is  not, 
whether  these  various  tools  are  economics  (which  they  clearly  are  not), 
but  rather  whether  they  are  genuinely  useful  tools  to  particular  pro- 
fessions. 

By  this  criterion,  it  can  be  categorically  stated  that  linear  program- 
ming techniques  have  a  real  contribution  to  make  to  business  man- 
agement. On  the  other  hand,  the  economist  who  ignores  programming 
techniques  may  not,  in  any  important  sense,  fall  as  far  behind  his 
"competitors"  as  a  business  management  almost  surely  will,  although 
this  is  by  no  means  a  certainty.  At  a  minimum,  the  economist  owes  it 
to  himself  to  give  at  least  a  cursory  examination  to  the  array  of  eco- 
nomic problems  in  which  these  techniques  can  be  used,13  before  de- 
ciding against  the  potential  of  such  tools. 

Even  in  the  case  of  game  theory,  it  is  not  an  open-and-shut  case 
that  game  theory  techniques  can  be  safely  ignored.14  Abstracting 
from  the  question  of  future  improvements  in  the  theory  underlying 
non-zero-sum  and  more-than-two-players  games  (which  is  a  ques- 
tionable abstraction),  this  is  still  true. 

From  the  viewpoint  of  business  management,  it  is  one  thing  to  say 

12  W.  J.  Baumol,  idem. 

13  Merely  thumbing  through  Dorfman,  Samuelson,  and  Solow,  op.  cit.,  without  worry- 
ing about  the  mathematical  arguments  developed,  should  be  genuinely  helpful  in  this 
respect. 

14  A  careful  study  of  the  recently  published  book  by  Martin  Shubik,  Strategy  and 
Market  Structure  (New  York:  John  Wiley  and  Sons,  Inc.),  1959,  might  well  show  this  to  be 
a  much  too  conservative  statement. 
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that  the  types  of  games  confronting  it  are  decidedly  limited  in  num- 
ber, and  it  is  quite  another  thing  to  say  that  the  number  of  problems 
falling  within  these  limited  types  is  quantitatively  unimportant.  A 
little  ingenuity,  coupled  with  an  understanding  of  game  theory  tech- 
niques, may  well  open  substantial  new  horizons. 

From  the  viewpoint  of  both  business  management  and  the  econo- 
mist, it  is  not  entirely  irrelevant  that  close  relationships  exist  between 
programming  and  game  theory  techniques.  Practically  speaking,  the 
importance  of  this  can  be  exaggerated.  On  the  other  hand,  the  proc- 
ess of  acquiring  an  understanding  of  programming  techniques  takes 
one  so  far  along  the  road  towards  understanding  much  of  zero-sum 
two-person  game  theory  that  it  should  almost  be  worth  one's  time  to 
go  the  rest  of  the  way,  merely  to  satisfy  one's  intellectual  curiosity, 
if  for  no  other  reason. 

Finally,  from  the  economist's  viewpoint,  it  should  be  recognized 
that  game  theory  techniques,  whatever  their  current  shortcomings  as 
a  quantitative  tool  for  coping  with  the  complex  problems  of  econom- 
ics, may  well  have  usefulness  as  a  qualitative  tool.  Here,  too,  Dorf- 
man,  Samuelson,  and  Solow16  cite  a  pertinent  illustration  in  "the 
concept  of  coalitions  maintained  by  means  of  side  payments  among 
the  members"  of  opposing  interest  as  a  theoretical  counterpart  to 
cartels,  adding  that,  had  this  vocabulary  been  in  use  in  the  day  of 
Edgeworth  and  von  Stackelberg,  they  would  probably  not  have  over- 
looked the  possibility  and  importance  of  such  coalitions. 

Such  is  the  main  outline  of  the  pros  and  cons,  as  the  writer  sees  it, 
with  respect  to  linear  programming  and  game  theory  techniques. 
Each  person  must  decide  for  himself  whether,  for  his  purposes,  the 
balance  is  a  debit  or  credit  one.  That  the  writer  has  assessed  the  bal- 
ance as  a  large  credit  one  is  fairly  obvious — for,  if  this  were  not  the 
case,  this  book  would  never  have  been  written. 

15  Dorfman,  Samuelson,  and  Solow,  op.  cit.,  p.  445. 
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